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ABSTRACT 

The comprehensive Des Moines Plan (DMP) for Des 
Moines, Iowa elementary through high school students throughout the 
district who recuire academic support was evaluated, as implemented 
during 1987-88. The plan represents an expansion and reorganization 
of all district remedial programs, and receives federal, state, and 
local funding. The DMP programs focus on providing 
reinforcing/remedial assistance according to students' learning 
strengths, based on the premise that early identification and 
intervention are more effective than later remedial efforts. The 
Kindergarten Enrichment Program, K-1 Transitional Program, 
Reading/Writing Lab Program, and Mathematics Lab Program uere 
evaluated. As of May 24, 1988, the programs served 206, 108, 2,877, 
and 2,365 students, respectively. The total full-time equivalent 
staff included 142.1 teachers / coordinators, consultants,* 
supervisors, and associates. The extent to which each program was 
implemented according to its respective process and performance 
objectives, procedures used, nature of students served, and follow-up 
on recommendations from previous evaluations of district remedial 
programs are discussed. The four program evaluations are provided, 
within this document, as separate studies, each presenting evaluation 
forms, checklist's, and sample tests. Fifty-four data tables are 
included. A supplement to the DMP program evaluations, the 
longitudinal evaluation study, and conclusions/recommendations from 
the DMP's comprehensive evaluation are also presented. (TJH) 
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DEPARTMENT OF EVALUATION. RESEARCH AND TESTING 
DES ttOINES'POBLlC SCHOOL'S 
EVALUATION ABSTRAnT 



October 31, 1988 
TITLE OF PROGRAM: 



The Des Moines Plan (including Kindergarten Enrichment 
Program; K-1 Transitional Program; ReadingA/Vriting Lab 
Program; Mathematics Lab Program) 



NUMBER OF STUDENTS 
SERVED: 



Kindergarten Enrichment Program: 2O6 

K-1 Transitional Program: 108 

ReadingAVritihg Lab Program: 2877 

Mathematics Lab Program: 2365 



The above numbers were based upon the number of students on the database as of May 24. 1988. 



FULL TIME EQUIVALENT STAFF: 



TOTAL ALLOCATION BY 
FUNDING SOURCE: 



EXPENDITURES BY 
PROGRAM: 



Supervisor: 1.0 

Coordinators: 1.0 

Consultants: 3.5 
•Teachers: 123.6 

Kindergarten Enrichment: 
K-1 Transitional: 
Reading/Writing Lab: 
Mathematics Lab: 

Associates: IO.O 

Secretarial: 3.0 

TOTAL: 142.1 



6.5 

8.0 
58.3 
50.8 



Educational Improvement Grant: 
Dropout Prevention: 
Budget Review: 
Chapter II: 
Chapter I: 

District General Fund: 
TOTAL: 



$522,936.00 
363.531.00 
592,375.00 
365,033.00 
2.268,045.00 
901,752.00 
$5,013,672.00 



Kindergarten Enrichment: 
K-1 Transitional: 
ReadingA/Vriting Lab: 
Mathematics Lab: 
TOTAL: 



$221,477.00 
$255,720.00 
$2,065,665.00 
$1,978,793.00 
$4,512,655.00 
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PREFACE 



IT^TJl^ ^ , ' P'^^^"*s an expansion and reorganization of all district remedial programs 
anIS ttoTlev's '° ''''' °' ^'^"^"'^^ -^^'^ 

in.PrvpTl!fnnSl°f ^i" ""^•'''y'"? ""^^^es Moines Plan suggests that early identification and 
n en/ention will have a greater impact on academic achievement than remedial efforts implemented 
o ' 'h'^'"'" ^'^P^"^"^- E^^'^ating this philosophy will require monitoring t^e need 

Z S^T^ T'^ '''^'^ '^^ P^°9^^"^ throughout their academic experience in 

?he dTs MoineTRan."^"^ ^ implementation and maintenance of the programs included in 

chantpTr?r?5^1.!!H?''"" comprehensive evaluation of The Des Moines Plan. Separate 

chapters are devoted to examining the extent to which each program in The Des Moines Plan was 

sS^mPntPd '"^ *° ''''''''''' perforrSance objectives. IhTs inform^ on was 

^oSiw w " ^ ^'^^"^'"^''on of the identification procedures, the nature of the students 
Mhounh ?p.n 1?°^ K previous evaluations of district remedial progSms 

Although results will not be available until after the close of the 1988-89 school year a descriotion o 
the design of the longitudinal study is also included in the full report. description of 

Whiip fl°c'^^'"'"'l"^^ "'""^ u'.""^ ^'^''^ '^''^P'^^ written as an independent document. 
White this approach may result in redundancy between chapters, it is hoped that it will meet the 

effSently' ' implementation of The Des Ses Ran more 

KINDERGARTEN ENRICHMENT PROGRAM 
Conclusions 

Pn Ji"® ^®f?^ °' of 'he process and performance objectives of the Kinderqarlen 

RP uS^nf h 7''."^ '"'^"'c"'' P^°9^^"^ implemented as outlined in the program description 
TrP^Jlp.^^^^^^ Enrichment Student Evaluation suggest that students do developTn the 

Cnnn?.. "^"^ emphasized in the program. Placement recommendations at the end of the proqram 
support this perception and provide evidence to suggest that efforts to improve the p^cement 
procedures resulted m the identification of students that more accurately reflected the target ooDulation 
for whom the program was created. Although class sizes were generally lowrthan originX Sed 

PipSl'""""'"'' 'I' 'r ' ^PProx'^'ed the ratioSg izi as Sfo'ea^ 

e lementaor programs. Finally, parents/guardians of students in the program indicated that he 

SSf "^^'^ ' ^'a"'"'^^"' "'"'"bution to the development of a positive 
altitude toward school and the teaming process. positive 

In rnany instances, performance exceeded expectations. For exampte the oerformanrp nhipniwpc 
spec, ed that 75% of the students served would be recommended for fif^. g ade at ^e 5 o?me 

.T ^^T ^'"^ "3"^'' '"^''^"''^ 85% Of these students were considered 

adequate y prepared for first grade. Although instructors were only required to make one contact with 
the parents/guardians of students served in their classes, results indicated thatTnrichren. teacier 
devo ed a considerabte amount of time and energy keeping parents/guardians inforLTof pr^^^^^^^^^ 
activities and student development in the program. """rmea oi program 
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■A nnfonT J?nf;-L 1^°^ ^^aluation suggest that the Kindergarten Enrichment Program provides 
-fir<Sp .SS^f ? 'i'^'PP^epa^e Students with moderate developmental deficiencies for success in 
S nhSt?nh.^J^°"?- "'P'^":^"'^"^" °' »he program accurately reflects Hs own philosophy as well as 
the philosophy of early elementary education in the district. 

Recommendations 

m.,^ f examination of the impact of early elementary programs suggests that students with 
^rZrnT ^^^'^'^'^'^^ might benefit from an additional haK day experience ?n \he 

^^^^"^'"odation of these students will require modification of the phito^^hy 
?roa?S and perfomiance objectives of the Kindergarten Enrichment 

Prog am in 1988-89. The following recommendations are submitted for consideration in the 
modifica'.ion process. • «■! m 

Pdn Ji-.r^wIJ ^°'^'lf' °^ work with representatives from the Department of Elementary 
Education and the Department of Educational Services to examine the philosophy statement 
underlying the early elernentary programs in the district to ensure that it includes a rationale for the 
TSt^n^^lT^' T kindergarten level. This rationale should also be reflected in the ph o«,phy 
statement of-the Kindergarten Enrichment Program. " 'u&upny 

fdPnSnn nr.oH°''^'",f [ should work With the Coordinator of Testing and Research to develop 

3. The inclusion of stiicJenls with more severe developmental deficiencies will affect exoectations for 

the absence of information upon which to base sound expectations, the program coordinator should 
establish no more than 50% as the criterion level for this objective, "biis criterion sS b^mcreased 
gradually as the program adjusts to the changes associated with the new target p^pSSon 

I'ft Jl'pn '"'^'^^'^ "'^ '^"'^"on parent/teacher contacts to more accurately 

reflect Enrichment teacher efforts and the emphasis characteristic of all Des Moines Plan ^ograms ^ 

LhSn 'T.?^''""^^"^''^'^"' P'°"'^^= a" '"^P°rt3nt contribution to a program 

evabalion. the return rate of efforts to solicit such feedback is not necessarily in the hands of the 
. program coordinator or teachers. The program coordinator should considen^e^vSe 30% return 
rate cnterion or eliminating the performance objective from the program entire^ 

K-l TRANSITIONAL PROGRAM 

Conclusions 

Prnn^oS?"'''^ • '^^""^^^ examination of the process objectives suggest that the K-l Transition 
nrST ' '"?P'^1^°"^^ in the program description. Teachers followed object ^es to 

provide a complete curriculum. They also made considerable efforts to keep parents and auardians 

01 eckpoinl results do indicate that the program is approaching the criterion level for^uccess- particularly 
in the area of reading Finally, while the return rale was insufficient to consider the resets as Imly 
representative, there is reason to believe that parents and guardians of students in the^ragram 1?^' 
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pleased with the impact of the program on their children. 

Recommendations 

suggests that students with more severe developmental deficiencies might benefit from an additional 
i^!nlrJ^^nfZ"'f J "l' ^^^^'^^anen year. Participation in this supplemental prog am ^uW Sg 
n mp nrnn?im fnf f 'Zl^^ ^'^ ^^^^^^"^ "^^^ therefore Tequire modificatton 

on fh?rp.MH^^^^^^^^ °^ "^^^ f°"°^'"9 recommendations are based 

of t^P P?rl plmlntt'' " H Consideration of pending alterations in the organizational structure 
of the early elementary academic support programs in this district. 

1 . The program coordinator should work with representatives from the Department of Elementarv 
Education and the Department of Educational Services to examine the philosophy statement ^ 
underlying a early elementary programs in the district. Particular attention should be Sted to 

Dh oXo hVrPn r l^^^^ P^°9^^"^^ consistentwi the 

philosophy of the regular.kindergarlen program. 

2. The program coordinator should work with the Coordinator of Testing and Research to examine thP 
impact 0 the structural change on the identification procedures for the ^1 Rogra^ NeressarJ^ 
modifications should be made to ensure that the most appropriate students are wTntiiied and Served. 

L 1^,^^^^^'"°"^' l^^'f day experience during the kindergarten year is likely to increase the "success" of 
the K-i Program as rneasured by first grade checkpoint results However, as students ser^edrthe K-l 
Program are identified in the spring of the kindergarten year, the effects o this structural chanae wiH no 
be experienced until 1989-90. Given the results of this evaluation, the prograr^ cioSator s^^^ 

4. First grade checkpoint results suggest that considerably more emphasis is given to the 
developmen of reading skills than math skills. Given that the K-1 Program is designed to provide a 
comprehensive curriculum, and that the performance objective to determine the "success" oMhe 
Kp!" r ""^'^ °^ "^'"^ checkpoint, the program coordinator should wor^ wi h K-I 
teachers to increase the emphasis on math skills. • worn wim m 

• cherSlpcM^riT'"''' *° "'^ "^^ P^°9^^"^ limited to the Jrst grade 

checkpoint results. As these are not available until the year following the current year of service thev 
are of limited value in the evaluation of the immediate year of service The program coo dinShoukJ 

Of t^e^ogl^T'''" *° " °' ''''''''' feedSaS ofthe eS 

5. The program coordinator should increase the criterion for parent/teacher contacts to more 
p?oXt °' Characteristic^ aK Des mXs Plan 

7. Although information from parents and guardians provides an important contribution to the oroaram 
evaluation, the return rate frcm efforts to solicit such feedback is not necessarily h the hands o^ 
program coordinator or teachers. The program coordinator should consider remov ng the 30% return 
criterion or eliminating this performance objective from the program entirely 
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READING/WRITING, MATHEMATICS LAB PROGRAMS 
. „ — — - Conclusions- - 

onw^f ""^ °- '^-^ ^^^'i'^''^" °f performance and process objectives suggest that student attendance 
f^r^.nZ!^^^^^'"'' ""^'^ P'^'"'' ^° ^^^^ Strong emphasis in these pr^rams in ,he 

oi^^S "'h^''"^' T!:'', °l ^PP^°>^'"^^'«'y 83 percent of the elementary studeS 75 percent 
of both m ddle and senior high students were contacted by telephone or in person durina the veaV In Thp 

swenls was ve,y similar. While cnlerion levels eslablished by Ihe prcpJJ^^ZTSa^SIs 

.noluded me amounl of gain in Ihe nomial curve equivalem score. On l^T^l^l^^^Z 
suwesuslabtehed crileha were exceeded when weighted averages were c^uK grldira-S and 

Two conditions thai may have adversely affected achievement gain during 1987-88 were: 

^« The Des Moines Plan lab programs were modeled after tht district's Chapter I and II Prooram.?- 

Droarams° A« nfnH°-*'' '^""^i^as involved in the lab programs had not partidpSn e Ch p' ' 
SlSvirv ,^ '"'IT' °^ "^^ implementation process, unfamiliarity with me model 

and delivery system could have had an adverse effect on achievement; and 

.dm-nl.,or ^^^^t^ '1^°'"^'^ "^^ain until January of 1988 following initial 

administration of checkpoints. This resulted in a considerable shift in the student popuSn at mid vear a. 
some students were exited from the program and others were entered. The end S was thaTpreS 
scores were available and included in evaluation results for students that may have Sed ins rE^^^^^^^^^^ 
S.V°; ' '^T °! ^'^'^ «>^P«^«d. This wouW be partSfy tme fof 

PH.lr * ?n ""^'^ P"P"' "'"^P'^'^ Tests of Basic Skills or Iowa Tes^s o 

pi., '^r^'^P"^^"* »he fall. This condition bears mentioning though an asssumption is hat the 
effect of It on the overall results for the program is probably slight. s>^=>umpiion is mat the 

..hnn?;!^!!?," ^1- =!^°'"^,'^^3"'^^i3'ed with the passage of time. Steps will be taken during the 1988-89 
Tn^eSi^^l^dtS " "'""^^ "^'^'"^^ ''"^-'^ '^^^ ^'en se.'ed for 

While there were at least two instances in which proper documentation to evaluate process and 
performance objectives was not submitted (noted in recommendations section) rappears from the 
c£ZZVf!:;S^ and Mathematics PrograL'SpSill'd as 

Recommendations 

1. The Supervisor of the Des Moines Plan should reassess the usefulness of the PrincipaPs Report of 
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SSs^^hould beS^P^^^^^ t '''' P^°3ram. If this type of report is deemed useful 

sieps snouid be taken to ensure the more timely and accurate completion of this form 

ReseaTh^S'^P^fnn^n ^^^"'r '° ""'J'^S 'nvo'vement of the Department of Evaluation and 



SUPPLEMENTAL INFORMATION 
Conclusions 



Studeflt Charar.tftnfft?i:s 



oqulablo dolivoo- 01 somce. While mo dislribulion of minoray sludonls represonlo'^j'n Sw^^^^^^ 
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?rTil?,T',![?H;^"' ^^"^"'^ ""'^ "''"o^^y representation exceeded this standard in the K-1 
Transition and tab programs. _ , „- - - 

PpIIq^ 19BR.fi7 Rpr.r> mmendatic>nft 

Evidence was available to suggest that a majority of the recommendations specified in 1986-87 
evaluations of the programs later subsumed in The Des Moines Plan were addressed by program 
coordinators. The results of a review of the procedures used in determining gain criteria on 
the outcome measure in the lab programs Is expected. 

Recommendations 

Idenllfifiatinn PfOCffT<|)'-ftfi 

nnd no J^fi?''!,'^"'?' °' ""^ ^""""^ '° work with the Coordinator of Testinq 

programs procedures that accurately identify students for the early elementary support 

iHonfr SuPef^'sor of The Des Moines Plan should consider including an item relating to the 
Identification procedures in the process and performance objectives for all Des Moines Plan programs to 
ensure that such procedures are evaluated on a regular basis. programs to 

Student Charar.tftrjfftj^f^ 

rv,;nnr-.„/I!;^ Supervisor of The Des Moines Plan should continue to monitor the distribution of 
minor ty/nonminorrty and maie/female students in the program. Particular efforts should be directed to 
ensunng that minority student representation does not exceed state criterion leveir 

Follow Up of iqRfi.R7 qftc ommftnriatinnR 

«mnl; I*]® Supervisor of the Des Moines Plan should continue to examine procedures currently 
employed to detemiine the criteria for "success.- particulariy in the lab prograrns. 

CONCLUSIONS AND RECOMMENDATIONS 
Conclusions 

Philosophy and fipnlf; 

jnrtJl^Ti!'^?^ °' '"^ Process and performance objectives of the early elementary support programs 
.to 'f ' ^' ^ri'f"^' experiences that consistently and accurately^eflected their 

S OH f • P'^"°s°P'^'es. However, in 1988-89 the Kindergarten Enrichment Prograrn wHI be 
modified to serve students who demonstrate the greatest need for academic support. Accommodatinq 
these students will require significant adjustments to both the identification procedures andThrou?come 
k'^^ T an°.-!;-nn p'' ^'"^'^l^li The additional preparation should have a direct affect on the nature o the 
K-1 Transition Program, and may be felt in the elementary lab programs as well. 

Identification Pfpfffijfjirft^ 

Identification procedures for all programs in the Des Moines Plan were determined after careful 
consKleration of district resources. Consistent with the philosophy of the Des Moines Plan, greater 
S "fJr ^"'!; '° '^'"9 ^'"^^"'^ 3' 'he elementary levels. For example, provisions or the 
Reading/Wnling and Math Labs included serving 20% of the students in grades 1 and 2 15% of the 
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« nSn ! 5" i f V?^'' ^ ^'""^'"'^ ^-^^ 8% Of the Students in grade 7. and 5% of the 
m^^^^^^^^ • H^""' ^'"^"^ es'^blished to identify students 

— the.first'gradeTeading'checkpolnt were served in the ReadingAVriling Lab. etc. 

sen/lISi".Kc^?? ^'"^k" Percentages ensure that those students most in need receive support 
services, they also introduce the possibility of serving students who do not really demonstrate need In 
other words, current identification procedures do not consider the level of mastery dTnwSted on Z 
checkpoints, but are based on the distribution of the checkpoint results anJthVnumb^of S?ces 
available for service at each grade level. Fot example, a firS^grade studentwho sc^r^d 80% c^^^^^^ 
cheS'int Sores' " '"^'"^ '''' '^^''^20% oSrst gr^^^^^ 

cheSint'tEnpH '"''^""^^ "9"'"^' misidentifications of this nature. DislricI 

Inl^^HT^ r f H. year mastery of curriculum objectives and are revised to reflect 

any modi icalions In those objectives. Increasing.the difficulty of the cur iculum objectives should 
mcrease the difficulty of the checkpoints and therefore, improve their power rd^rtSa^e a^nn 
students level Of functioning. To follow up the example, a score of 80% would Z SfaW wShe 

would be much broader. However, curriculum objectives are reviewed on a five year schedule aiid 

S>?? 5 ''V^' ^'^'"9'^ '^'^^ '° ^° Additional years. ThiSflJie ma^^^^ be 
sufficiently sensitive to avoid misidenliffcations. unie ime maynoioe 

Qroanizational Strudiir«> nf the Mana^Pmsnt SvstPrg 

The Des Moines Plan W.5S based on the district's Chapter programs. ln1986-87 theChaoler 
prograrns involved 31 schooli; across the distrfct. In 1987-88. the Des Mo nes Plan Iricluded aS 
buZTrlTn^'u'"'' ^^Sular academicVrogramming in the 3i ric,? 58 

Snnel In addrtion Thp r H.'.f "° ^1° '''^ ^'^"^^"'^"y P^^^^^"^^ ^'"'^ '^'^^ accompanying 

personnel in addition, the Chapter programs relied on two sources of funding; however 

approximately 82% of the funds :or the Des Moines Plan were contributions from «ve st J^e or federal 

!mr,Sn.!I;fnn^nMK'" '° ""''"^3' '''' ^'^^P"' P'°9'A"^2 successfully accounted for the 
implemenlalion of those programs, the same system failed to withstand the demands imposed bv the 

oKpr'r'°K'''''' '''' f''^"- Accountability flies we?e estTbl shedTr^onrt^^^^ 

objectives of each program in the Dos Moines Plan, and within each grade level of the lab programsTe 
elemerilary. middle, and high school). Similarities in the nature of the program objecMves E^sutd in 
rnain ainmg mu l.ple sets of files wilfMhe same documentation. FurlheVmore. regulate as ociSS^ 
the anocalion of funds from external sources complicated the maintenance of account ledgers ^or each 

Recommendations 
The following recommendations iire based on the conclusions Usted above. 

i; J-!.i"P.'!y;L°.':°' "^I^" Plan should meet with representatives from the Deparlmenl of 

uZZh^ """iTT' ^fP^""^^"* °' Educational Services, and the Deparlment of Evaluation 
Research, and Testing to review the implications of the modification to the Wndergarlen Enr chmeni 

P^°9^^"^^- P^^'^^'A^ A»«""°" should be given ?o e ami ng the 

L:Srgrar,aTp^r:grar '''''''''' ^^P-'^''°- °' K-l T^on 
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n*.nf rtmif « af ^"Pf^'so:; °' The Des Moines Plan should meet with representativosjrom Jhe- 
^DepartmenUf.Elementafy€ducatfonrthe'Departr^^^ 

,hp iirJ^^?;"'f '''5' ""^ Coordinator of Testing and Research specSfcat to rellew 

the al ocat,on of academK) support resources. The number of students served at each nrade level 4Tuld 
be determined on the basis of available resources, checkpoint results, and other rlvaSoSo,?^ 

lvaSfin>,"Cl°r^? "^''h P'^n should meet with representatives from the Department of 

Evaluation. Research, and Testing, and the Controller's Office to devise a system to monitor the 
implementation and accounting of Ihe Des Moines Plan more efficiently "^nnorme 
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PREFACE 
The Plan For Excellence 
In 1S82 an administrative committee of the Des Moines Independent Community School District 
began developing a model progranri to improve student achievement in the district. Literature on 
excellence in education identifies areas that offer the greatest promise for impact on student 
achievement. The district's Plan for Excellence (1985) outlines steps to improve education in each of 
these areas. One of these recommendations describes steps to strengthen programs and 
achievement specifically for low achieving students including reorganizing all district remedial programs 
under a single umbrella. The Des Moines Plan: A Plan for Student Success was implemented in 1987- 
88 to coordinate remedial efforts. 

The Des Moines Plan: A P!an for Student Success 
Component Prograrns 

The Des Moines Plan is a comprehensive plan for students throughout the district in need of 
academic support. The basic philosophy of the plan assumes that all children can learn and recognizes 
that students ieam in a variety of ways. Programs included in the Des Moines Plan are designed to 
■--IPIoy.jjg^'jMngW to studenis-'learTiitig stfefigth^s. ' 

Earlv Flft mentary Pmg rarns 

Programs at the early elementary level (i.e.. Kindergarten through grade 2) are characterized by a 
philosophy based on accepted principles of early childhood growth and development. Children from 
birth to approximately age 7 develop at variable rates. As a result, students who satisfy the age criterion 
for entrance into kindergarten may demonstrate developmental deficiencies in other areas that 
compromise their chances for a successful kindergarten experience. Failing to receive an adequate 
foundation in kindergarten could jeopardize students* chances for successful learning experiences In 
first grade and beyond. Des Moines Plan programs at the early elementary level are designed to provide 
children w'rth additional time and support to strengthen their weaknesses and better prepare them for 
first grade. 
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Des Moines Plan programs at the early elementaor level include the Kindergarten Enrichment and 
K.I Transition Programs. Students who demonstrate moderate developmental deficiencies- during the 
kindergarten screening process are gK.en the opportunity to receive an additional half day instruction to 
supplement the regular kindergarten curriculum in the Kindergarten Enrichment Program. The 
Kindergarten Enrichment Program was piloted in 1985-86 and became a component of the Des fv^oines 
Plan in 1987-88. 

Students Who demonstrate more severe deficiencies benefit from the interaction with same age 
peers in various stages of development in the regular Kindergarten program their first year and may be 
given an additional year of reinforcement in the K-1 Transition Program the following year. The.K-1 
Program was introduced in 1986-87 and offers a complete, comprehensive curriculum to reinforce and 
extend the social, academic, emotional and phy.^ical growth that occurred during the kindergarten year. 
Re^ding/Writ ino and Mq{h | ' 

Students Who fail to satisfy district standards in the basic skills areas receive assistance through 
ReadingAVriling and Math Lab Programs. Modelled after the Distrfcfs Chapter I and II programs, the 
basic skills labs include individualized remediation plans to allow students the opportunity to strengthen 
specific Skill deficiencies according to their academic strengths and preferred learning styles. Students 

^•El^i^^^l^^^^lajese^^^ 



assistance through regularly scheduled courses. 
Transition Rnp mf; 

Students Who have participated in the lab program for three consecutive semesters and have had 
the opportunity to attend two summer school sessions, but continue to demonstrate critical skill deficits 
are enrolled in special curriculum rooms. These -transition" rooms are introduced between grades 2 
and 3. 4 and 5. and 6 and 7. Prima^r emphasis is devoted to strengthening basic skills in reading, 
writing, and math. As the Des Moines Plan officially began in January of 1988. transition rooms will not 
be-implernented until 1990-91 to allow stydenls sufficient opportunities to strengthen academic 
weaknesses in the lab programs. 
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Fundino 

The Des Moines Plan receives economic support from a variety of federal, state, and local sources. 
Federal Sup por t 

District allowarwes under Chapter I and II of the Education Consolidation Improvement Act and other 
provisions to promote desegregation programs make a substantial contribution to programs at the 
prirnary and elementary level. 
State Support 

In addition to the state base rate allocation, the district receives support for special programs 
through the "allowable growth" mechanism included in the slate funding formula. The allowable growth 
mechanism permits local districts to assess additional local taxes for the purpose of promoting school 
improvement. Allowable Growth funds were awarded by the state in response to a special request to 
the State Budget Review'Commitfee by the district for funds to support the Des Moines Plan. 
Addftiona! funds provide support fc. the Educational Improvement Grant (i.e.. the Plan for Excellence) 
and the Drop Out Prevention Programs in the district. Because the Des Moines Plan is an integral part 
of both programs, a portion of the monies from these grants is allocated to Des Moines Plan programs. 
Local Support 

1_ ^eachersalaries-and associated benefitsnot coveredby.other-sources.arexredlted to the^districfs 

generalfund. ' . 

Plan Of Evaluation 
RalionalQ 

The philosophy underlying the Des Moines Plan suggests that early identification and intervention 
will have a greater impact on academic achievement than remedial efforts implemented later in students' 
academic experience. To the extent.that the Des Moines Plan is effective, it follows that students who 
^ were served in programs, particularly at the primary and elementary school level, should not require 
continued assistance throughout their academic experience in the district. It also follows that 
participation in the academic support components of the plan should reduce the need to retain 

15 
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Students. 

SummativP Fyflliff^tr^rt 

The nature of these expectations suggests that a complete evaluation of the Des Moines Plan will 
require nrwniloring the need for academic support among students served in the program throughput 
their academic experience in the district. Such a study was initiated in the spring of 1988. The.design of 
this study calls for following students who were identified and served in Des Moines Plan programs that 
spring to determine the extent to which students require additional assistance and to identify the nature 
of that assistance. 

Formative Fvalnqtign 

As with any education program, the Des Moines Plan was created to meet the needs of students in 
the district and must change as these needs change. The longitudinal design described above and the 
dynamic nature of these programs increases the need to monitor the implementation and maintenance 
of the Des Moines Plan programs. Results of these studies may identify areas that have as significant 
impact on the effects of the programs.' Information will be drawn from two sources to provide adequate 
documentation of the implementation of the programs. 
Process and Pftrf ormance Dhi pr^trvftc; 

Each program within the Des Moines Plan is guided by a series of process and performance 
objectives. These objectives specify activities and performance criteria to ensure continuity in the 

-implementation of.the-programs.in.ali-schools.across.the.district.and.to.provide.preliminary-evidence-of, 
the effects of the programs. 

SuoDtemontal |nforqir{'(?n 

An examination of the process and performance objectives will document the extent to which the 
program was implemented as planned, but will not allow an examination of critical issues that go beyond 
the objectives. A thorough formative evaluation will require supplementing the compliance information 
with data to address specific issues, such as the adequacy of ihe objectives and the validity of the 
identification procedures, as they arise. 

ERIC 1.0 



5-5 

Overview of the Comprehensive Evaluation of The Des Moines Plan 
The following report represents the first comprehensive evaluation of the Des Moines Plan. 
Separate chapters are devoted to each of the components outlined in the description of the evaluation 
plan. Chapters 1 through 4 examine the process and performance objectives for each program 
included in the Des Moines Plan. Chapter 5 reviews each program with regard to three specific areas 
not directly assessed by the process and performance objectives, namely: the validity and reliability of 
the identification procedures, the nature of the students served in the programs, and a follow up of 
recommendations from previous evaluations. The results of the evaluation of the process and 
performance objectives, considered with the supplemental infomiation reported in chapter 5 are 
designed to provide the background and descriptive information to support the longitudinal study. 

The Des Moines Plan was officially implemented in January 1988. As such, the results of the first 
year of the longitudinal study will not be available until the spring of 1989. However, chapter 6 describes 
the evaluation design of the longitudinal study in greater detail. 

Although conclusions and recommendations are specified at the end of the process and 
performance evaluations for each program, chapter 7 provides the opportunity to formulate conclusions 
regarding the Des Moines Plan in general based upon a synthesis of all available information. 
Recommendations to improve the deliver>' of services and/or programming based on the conclusions 
are also submitted. 

Finally, a note about the forniat of this report. Implementation and oversight of the Des Moines Plan 
-involves-a variety of-individuals who serve in different capacities. To maximize the utility of the report, 
each chapter is written as an independent document. While this approach may result in redundancy 
between chapters, it is hoped that it will serve to meet the specific interests of all those involved more 
efficiently. 
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INTRODUCTION 
Background Information 

The Kindergarten Enrichment Program is a supplemental program to reinforce and extend the 
foundation concepts and skills of the basic kindergarten program. It was developed and introduced into 
the district in ^985-86 and was incorporated into the Des Moines Plan in 1987-88. The incorporation 
procedures required a slight modification in the structure of the program namely the inclusion of process 
and performance objectives. The primary purpose of this evaluation is to document the extent to which 
the Kindergarten Enrichment Program was implemented according to the objectives outlined in the 
program proposal. The results of the evaluation are presented following a description of the program. 

Program Description 
Administration 

In 1987-88. the Kindergarten Enrichment Program was coordinated by an elementary school 
principal. In addition to administrative responsibilities, the coordinator chaired the Kindergarten 
Enrichment Planning Committee, which also included Kindergarten Enrichment instructors and the 
Elementary Consultant. This committee met at least monthly to develop program and curriculum 
modifications necessary to conform lo the Des Moines Plan, to discuss difficulties and to exchange 
curriculum ideas and activities. It was also primarily responsible for implementing the program. 

Allendanr.P Qpntftfs 

Thirteen half day sessions were offered at eight elementary schools throughout the district 
including: Brooks. Cowles. Findley. Howe. King. Mann. Moullon. and Woodlawn. These centers were 
chosen on the basis of enrollment figures and the availability of space. With two exceptions, the 
remaining elementary schools were divided into attendance areas that clustered around these target 
sites. A sufficient number of eligible students were identified at Moullon and King Elementary Schools 
lo offer one half day session al each of these sites. As a result, one session was eliminated at 
Woodlawn Elementary School. Two sessions (i.e.. one morning and one afternoon) were held at the 
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remaining five centers. 

Class Si7ft 

Original class sizes were limiied to 18 students per session. Previous attendance patterns of the 
Kindergarten Enrichment Program were characterized by frequent transfers. Program policy provides 
that once a student has been identified, accepted, and served, they are not denied services in the 
event of a transfer, due to class size. When a student transferred to a home school within a different 
Kindergarten Enrichment attendance center, he/she was admitted to the new Enrichment center upon 
notification of the home school. Slight deviations in class sizes were allowed to accommodate transfer 
students: however, if a specific class enrollment exceeded 20 students, busing to another center was 
considered. Alternate placement decisions were made by the program coordinator, in consultation with 
the teachers involved. 

. Budgpt anf^ Expfinriifu rff;; 
As a pilot the Kindergarten Eririchment Program was funded througi.. allowable growth funds 
awarded to the district for the Education Improvement Program Grant (i.e.. the Plan for Excellence). The 
following year the program was incorporated into the district at large and expenses were absorbed into 
the general district operating funds. As part of the Des Moines Plan, the Kindergarten Enrichment 
Program was funded through federal, state and local sources. Federal funds were provided through the 
Chapter I Program. The State of Iowa contributed through the Educational Improvement Program Grant. 
Local monies for transportation and the Voluntao^ Transfer Program were also allocated to the 
Kindergarten Enrichment Program. 

Table KE-1 lists the budget and expenditures for the program. Budgeted figures were estimated 
on the basis of district averages. The average teacher salao^ for 1987-88 was $26,389. Estimated 
salaries and benefits for five full time and three half time instmctors based on this average was 
$171,528. Each building received $24.10 per student for supplies and equipment. Multiplying this 
figure by the average number of students served in the program during the year (207.5) provides an 
estimate of the budget requirements for the program. Transportation demands were estimated by 
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multiplying the average cost per t.•^Jdent in 1^,37-88 ($155.74) by the average number of students 
served in the program. 

Stalo and federal regulations prohibit intermingling of funds, therefore, expenditures are reported 
according to funding source. Expenditures for supplies and materials were recorded for elementary 
programs combined. The figures listed were estimated on the basis of the relative number of students 
in the Kindergarten Enrichment Program. Transportation expenditures were credited to the district 
general fund. Actual expenditures were therefore, not available specifically for the Kindergarten 
Enrichment Program. 

Estimated total expenditures for the program represent an over expenditure of approximately two 
percent; however, the number of estimated figures in the table challenges the accuracy of this review. 
Current record keeping procedures, complicated by th6 number of funding sources and associated 
accountability stipulations, failed to.provide clear evidence of the actual budget and allocations. 

Table KE-I. Estimated Program Budget and Expenditures for Kindergarten Enrichment 1987-88. 

Items 



Source 


Salaries/ 
Benefits 


Supplies/ 
Materials 


Transportation 


Total 


Budget 


$171,528 


$5,001 


$32,316 


$208,845 


Chapter 1 


$135,069 


$957 




$136,026 


Education 
Improvement 


$33,071 


$957 




$34,028 


District 


$10,107 




$32,316 


$42,423 


Total 

Expenditures- 


$178,247 


$1,914 


$32,316 


$212,477 



Philosophy and dcf^lf^ 

The philosophy of the Kindergarten Enrichment Program is based on the philosophy of the 
Des Moines Public Schools kindergarten program and emphasizes a developmental orientation. It 
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States that Early childhood programs have a responsibility to help all children 'be what they are and 
become what they are capable of becoming.' This requires recognizing each child's individual 
developmental maturity and providing experiences to encourage further development. Educational 
experiences focus on readiness experiences which develop personal social/emoiiona! skills, intellectual 
functioning, verbal fluency, psychomotor abilities, and basic life skills to prepare 5i...!:,.nts to live with 
self, parents and friends; to approach the world with curiosity and creativity: and t.-> .elop effective life 
skills with a disposition for life long learning. 

The following goals were developed to guide the implementation of thi.s philosophy: 

1 . Apply the principles of growth and development as a foundation for le8f:i,V.g and 
learning. 

2. Provide a planned, comprehensive program of .experiences designed to c\-.c'.op the 
cognitive, affective, social., verbal and psychomotor abilities of each child. 

3. Ensure that the school's learning environment facilitates productive thin!<i:.-:. learning 
and living. 

CurriCDliirri 

The curriculum of the Kindergarten Enrichment supplements, without duplicaSing, the curriculum 
presented in the regular kindergarten program in an attempt to reinforce and er.^-- student 
preparation for future academic success. The curriculum of the regular kinderga.:.- . p.-ogram utilizes 
Strategies in Early Childhood Education (Waupun); a developmental approach tc .--luM, auditory, 
verbal, and motor skill development. The behavioral objectives in each area are arr:..-ocd m five 
performance levels. After locating students within the hierarchy through screenir-a ^chers present a 
complete sequence of Instruction, reinforce .ki.'l development, and confirrr, studo.;.-/ .biiities to perform 
a particular objective independently before proceeding to the next skiil level. 

The Kindergarten Enrichment Program enhances the Waupjn curriculum will-, i.-.o following 
objectives based on its specific goals to provide n plannc.d. co'-nprehensive program: 
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1 . Develop personal social/emotfonal skills to enhance self-concept, confidence and a 
disposition for life long learning. 

2. Promote verbal fluency through language experiences as a means to develop 
communication and seif-expression. 

3. Explore literature to build a positive self-concept, enlarge vocabulary, stimulate 
imagination, develop listening skills and broaden the students* view of the world. 

4. Expand intellectual functioning through thinking skills, such as problem solving and 
decision making. 

5. Integrate psychomotor skills into the learning activities. 

6. Emphasize good health and safety habits. 

A complete list of performance objectives for the emphases specific to the Enrichment Program Is 
found in Appendix KE-A. While progress on the Waupun curriculum objectives is monitored by the 
teachers of the regular kindergarten program. Enrichment teachers measure progress on the special 
emphases by the results of a checklist of specific behaviors related to each performance objective. 

Teaching Tfinhn'qili?^ 

Consistent with principles of early childhood learning styles, teaching techniques emphasize 
numerous "hands-on", manipulative and tactile experiences to provide opportunities to examine, 
investigate, explore, experience and discover. 

Jdentificalion Prnpft(f|frff^ 
Prior to the introduction the Kindergarten Enrichment Program all kindergarten students were 
screened during the third week of the school year to determine their standing within the Waupun 
curricul'j.Ti. The results of this screening provided teachers with a rough estimate of where to begin 
tnslmclion. implementation of the Kindergarten Enrichment and other early elementary academic 
support programs, necossilatod more rigorous selection procedures to accurately and consistently 
identify appropriate candidates for the program. 

To date, the Kindergarten Enrichment Program has relied on the results of the Kindergarten 
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Enrichment Teacher Evaluation Form (see Appendix KE-B). This was administered to those students 
who performed below the minimum Waupun level considered prerequisite for success in kindergarten, 
and who teachers believed to be appropriate candidates for the Kindergarten Enrichment Program. 

In 1987-88 a pilot study was conducted to examine the technical properties of current screening 
procedures and to explore the possible use of an alternative instrument. The screening test of the 
Battelle Developmental Iriventosy (BDI) was administered in lieu of the Waupun screening and the 
Kindergarten Enrichment Teacher Evaluation to all kindergarten students in six schools across the 
district. Students from all other elementary schools were referred according to the original placement 
procedures described above. ' ' 

Candidates from all schools were confirmed by the home school principal and the Kindergarten 
Enrichment instructor for the attendance area, and were referred to the Enrichment Planning 
Committee for review. The results of all referrals were rank ordered within the respective tests. 
Students referred on the basis of the Kindergarten Enrichment Teacher Evaluation Form were selected 
according to criteria established from the results of previous years. Students referred o.i the basis of 
the BDI screening test were placed according to criteria derived from normative data provided with the 
screening test. Additional infomiation such as the results of draw-a-person and scissor culling tasks jnd 
teacher observations, was used to identify students with the greatest need.and/or to verify a placement 
decision- Selections were confirmed with the home school teachers and principals. 

Final placement was contingent upon approval from the parent/guardian. Parent contacts were 
initialed by the home school principal and followed up by the Kindergarten Enrichment teacher. 
, PROCESS AND PERFORMANCE OBJECTIVES 

Introduction 

Process and performance objectives were generated in four major areas to guide the 
implemenlalion of the program. These areas included: Administration. Students. Instructional Staff and 
Family. The methods for documenting and evaluating'each objective in these areas, as well as the 
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results of the evaluation are described below. 

Administration 
Objective B-l 

During the Instmclional year the program coordmalor will orgarMze and maintain an accountability file 
and provide copies of data to support the evaluation of &II objectives as documented by an 
accountability file maintained by the program consultant. 

Evaliiatinp Mftlhfff^ 

Evaluation of this objedive called for simply confirm'ing the existance and maintenance of an 
accountability file: Maintenance was confirmed by requesting infomiation as specified in the program 
objectives. 

Results 

W The program evniuator confimied the creation of the files and received ail data in a timely fashion as 
specified in the program objectives. 

Students 

Qbicdivp A-t 

^^^^^^^ of the instructional year, students served by the program for at least two thirds of a given 
year wit! improve an average of one ranking on each of the components on the Kindergarten 
Enrichment Student Evaluation as documented by a summary of the results submitted to the program 
coordinator by May 15, 1988. 

£ya!iial!Qn.M£lii£i£l 

Kindergarten Enrichment classes met for a total of 155 days. Only those students who attended 
103 or more classes during the academic year were included in the evaluation of this objective. 
MeasufQ 

The kindergarten Enrichment Student Evaluation was generated to more accurately reflect the 
specific objectives of the program (see Appendix KE-C). Four to 8 items were empirically derived to 
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represent 5 of the six curriculum objectives outlined in the program description. The objective 
"exploration of literature-, was considered descriptive of the teaching strategy rather than a student 
behavior and was therefore omitted from the Student Evaluation. Teachers were asked to indicate on a 
scale of 1-5 the extent to which each student demonstrated at least age appropriate levels of each 
Characteristic (1=infrequently. 5=fren.ently). Subscores were obtained by adding the scores for each 
item within each objective. A composite score was obtained by adding the scores across objectives. 
Although pre and post test scores were obtained on the Kindergarten Enrichment Student Evaluation 
during 1987-88. delays in its development resulted in subsequent delays in the initial administration. 
The results below represent student growth over a 4 month period. 

BesuIlS 

The results of a comparison between pre and post test scores of the Kindergarten Enrichment 
Student Evaluation are presented ih table KE-2. The results indicate that the subscale and composite 
_i5?ie^Wained.on.the.post4est-were-signficantly-highW'th-aT^^ 
represent a statistical difference, it is difficuit to determine whether the difference represents a 
meaningful change in behavior. This interpretation is compounded by the absence of a comparison 
group and the limited duration between test administrations. 

Table KE-2. Kindergarten Enrichment Student Evaluation Pre and Post Test Comparisons 





Objective 


Average 
Pretest 


_„Ay;erage. 
Post test 


T-StatistiC- 


-EffecfSize 


Perceht 




Personal Social/Emotional Skills 19.42 


23.70 


13.12* 


0.90 


Increase 
17.24 




Verbal Fluency/Competency 


26.85 


32.50 


15.80* 


1.01 


17.21 




fntellectual Functioning/ 
Disposition for Life Long 
Learning 


12.89 


15.31 


12.24* 


0.77 


14.24 




Psychomotor Skills 


20.28 


24.18 


15.27* 


1.01 


15.56 


' m 


Health and Safety Haoits 


21.61 


25.69 


19.16* 


1.16 


16.56 




Composite 


100.92 


121.31 


12.76* 


1.09 


16.85 


i 
1, 


• p< .001 
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One approach to facilitate the Inteipretation of these results is to calculate the effect size based on 
the difference between pre and post test scores. The effect size is an index of the degree to which a 
characteristic is present. An effect size of .25 represents a small effect. .50 represents a moderate 
effect and 1.00 represents a large effect. The effect size for each subscale and the composHe are 
included in the table. With the exception of the Personal Social/Emotional Skills and the Intellectual 

, — 

Functioning/Disposition for Life Long Learning scales, the effect sizes satisfy Cohen's criteria for a large 
effect. The effect sizes for the two exceptions approached this criteria. 

The interpretation may also be enhanced by calculating the percent increase in the scores, 
represented by the average difference between pre and post test scores, relative to the range of 
possible scores on the subscales. Percent increases ranged from 14.24% to 17.24%. The greatest 
increases occurred in the areas of personal social/emotional skills and verbal fluency/competency, two 
of the primary concems of the program. The lowest percent increase occurred in the area of intellectual 

functioning/disposition for life lon g teaming. . 

Although inconclusive, these results provide evidence to suggest that the program does make a 
positive impact on development in those areas it was designed to improve. 

Obiectivfi A-3 

At the end of the instructional year, at least 75 percent of those students served in the program for 
^ifeasttwothirdsofagive^yearv^llbejecorrme^^ 

placement recommendations for each student served in the program, submitted to the program 
consultant by May 15. 1988. 

£ya?L' qtion Melhofj 

Again, only those students who participated in the Kindergarten Enrichment Program for 103 days 
or more were included in the evaluation of this objective. 

Measure 

The purpose of the Enrichment Program is to prepare high risk students for the first grade. 

Er|c 2B 
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therefore, placement recommendations made in the spring of the kindergarten year serve as a measure 
- of the effects of the program. There were at least four alternative placements for students following their 
kindergarten year. Students could be retained in kindergarten, in which case they were eligible for 
another year in the Kindergarten Enrichment Program, invited to participate in the K-1 Transition 
Program, promoted to the first grade, or referred for evaluation and service by Educational Services. 

Retention in kindergarten and participation in the K-1 Transition Program was also contingent upon 
approval of the parents or guardians, therefore teacher recommendations for academic placement is 
considered a more accurate index of a student's level of functioning at the end of the kindergarten year. 
These recommendations are made by the students' regular kindergarten instructor in consultation with 
the Enrichment teacher. 

Result? 

The placement recommendations for students who participated in the Kindergarten Enrichment 
.erogram for-at-least-l 03 days are displayed in Table KE:3. These results indicate that over 85 percent of 
these students were considered adequately prepared for first grade. Only 14.56 percent (n=23) were 
referred for consideration for retention, and none of these students demonstrated a need for 
Educational Sen/ices. 



Table KE-3. Placement Recommendations of Students Served in Kindergarten Enrichment for 1 



03 



Placement 
Recommendation 


-Days or.More. 

Number of 
Students 


Percent of 
Students 




135 


85.44 


Refer to K-1 Transition 


19 


12.03 


Retain in kindergarten 


4 


2.53 


Refer to Educational Services 


0 


0.00 


Total 


158 


100.00 
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Instructional staff 

Obiective B-f 

Kindergarten Enrichment students will be identified by the fourth week of the instructional year as 
documented by class lists of identified students and eligibility data, on file with the program consultant. 

Evaluation Mp^lipfj 

Evaluation of this objective required reviewing program records to note the time line of the 
screening and placement procedures. 

Classes for the 1 987-88 academic year began on September 1 . 1 987. Kindergarten screening 
took place during the week of September 14-18. three weeks into the school year. Results of the 
screening tests were reviewed and the parents of eligible students were contacted during the following 
week (September 21-25). Although eligible students were identified by the fourth week, obtaining 
parent permission and securing class .'osters from the list of candidates, and making final transportation 
arrangements required postponing the start of the Kindergarten Enrichment classes one week. 
Kindergarten Enrichment classes began on October 6. 1988. 

Obiective R-p 

During the instructional year Kindergarten Enrichment teachers will instmct 18-20 students 'n each 
half-day session as documented by class lists compiled from student data forms, submitted to the 
program consultant by October 9, 1987. 

Evaluation fJlP\hQr\ 

The average cla^s size at the beginning of the program was compared to the average class size at 
the end of the school year to detemine the extent to which the targeted student/teacher ratio was 
maintained throughout ttie year. 

Results 

Class sizes at the beginning of the school year ranged from 14-20 and averaged apprcxiinalciy 17. 
Class sizes at the end of the year ranged from 13-20 and averaged approximately 15. Those results 
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indicate that studentAeacher ratios were maintained below the target level, and more closely 
approximated the ideal ratio for similar programs (i.e., 12-15 students.). 

Obiedive R-3 

By the end of the second semester, Kindergarten Enrichment teachers will have had at least one 
contact with the parent(s)/guardian(s) of each student enrolled during the instmctional year. These 
activities may consist of one or more of the following: a) ParentAeacher conferences; b) Kindergarten 
Enrichment newsletters; c) Kindergarten Enrichment open houses; and d) Parent volunteer activities as 
documented by attendance reports, copies of newsletters, and other appropriate documentation, 
submitted to the program consultant by May 15. 1988. 

Evaiuatinn Mftth'^'^" 

In addition to reviewing program records. Kindergarten Enrichment teachers were asked to 
^ complete a Parent Contact Summary Sheet during the spring semester of 1987-88 academic year. The 
parent contact summary sheet was designed to indicate the extent to which each teacher made 
individual as well as group contacts. 

BesilUs 

The very structure of the program ensures at least some contact with parents during the year. The 
parents of all eligible students are contacted by teachers during the selection process to confirm 
placement. Before the program begins, all parents are invited to an open house at each center to give 
parents an opportunity to visit the rooms and to team more about the program. District wide 
parent/teacher conferences are held in the fall and spring. Kindergarten Enrichment teachers were 
available at the students' home schools during conference times to supplement the feedback from the 
regular kindergarten teacher. They also prepared an insert for each student's report card to inform 
parents about the progress of their child specifically in the Kindergarten Enrichment Program. Finally, 
teachers were encouraged to circulate a Kindergarten Enrichment Newsletter to keep paren.o informed 
of Enrichment activities on a periodic basis. 

The results of the Parent Contact Summary Sheet indicate that an average of 7 letters were sent 
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home each session between February and May of 1 388. Approximately four of these letters were 
program newsletters. The remaining letters were notes and announcements related changes in 
building schedules, etc. In addition to Newsletters and other written announcements an average of 60 
individual notes were sent home per session during the recording period to provide parents with 
feedback about their child's behavior. At least 69 percent of these notes reinforced students for 
positive or appropriate behavior which reflects the positive emphasis expressed in the philosophy of the 
program. Teachers also made phone contacts and held conferences with parents beyond the 
scheduled district conferences. An average of 7.46 phone contacts and 25.46 individual conferences 
were made per session during the recording period. Finally, some teachers also noted participation of 
parent volunteers for field trips and special sessions as well as classroom visits by parents/guardians. 

These results were based on recordings over a 4 month period and included some inconsistencies 
that required interpretation by the evaluator. therefore they probably represent an underestimate of the 
actual contacts made by teachers. Neve rtheless, this l imited sample suggests that teachers devote a 
considerable amount of time and effort communicating with parents/guardians about student progress 
as well as Enrichment activities. 

Obiectlvff R.4 

During the instructional year the following objectives will be emphasized: a) Development cf 
personal social/emotional Skills to enhance self-concept and self-confidence; b) Development of verbal 
fluency/competency through language experiences; c) Exploration of literature; d) Expansion of 
intellectual functioning and development of a disposition for life long learning; e) Integration of 
psychomotor Skills into learning activities; and!) the demonstration of good health and safety habits as 
documented by the results of the Kindergarten Enrichment Observation Checklist, on file with the 
program evaluator. 

Evaluatlnn Mftlh^tf 

Each Enrichment session (i.e.. a.m. and p.m. sessions at all of the centers), was treated as the unit 
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Of analysis to evaluate this objective. 
Measure 

The Kindergarten Enrichment Observation Checklist was generated in consultation with the 
Enrichment instructors, to reflect most of the goals and objectives or emphases of the program (see 
Appendix KE-D). "Expansion of intellectual functioning and the development of a disposition for life 
^ long leaming- was omitted from the obeservation checklist because its focuses on individual student 
* Characteristics and does not have physical or behavioral components that could be readily observed in 
the classroom. 



ensure 



Procedure 

Once constructed, the observation checklist was used by the program evaluator to 
consistent observations during onsite visits to all of the Kindergarten Enrichment sessions. These visits 
took place between April 1 1 and April 27. Each visit lasted approximately 30 minutes and an attempt 
was made to schedule the visits around a teachefs planning period to allow time for a brief interview. 

Result^ 

The results for one session were eliminated because it was conducted by a student teacher rather 
than the regular Kindergarten Enrichment instructor. All objectives, as operationalized by the items on 
the behavioral checklist, were either observed directly or noted in the instructor's lesson plans i,. 3 of 12 
sessions (66.67%). Teachers in three of the four remaining sessions described activities they 
incorporated into their classes to address the areas not directly observed. There was only one session 
that offered insufficient evidence that all objectives were emphasized during instruction. Th^^^^^ 
which no evidence was obtained was psychomotor skill development. 

Family 
Objective A-i 

Near the end of the instructional year at least 30 percent of the parents of Kindergarten Enrichment 
students will provide formative feedback on program activities as documented by a summary of 
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responses obtained from a parent survey conducted by the program evaluator. 

Evaluation MAtf^nrt 

Because of the limited size, all parents/guardians of students in the program were asked to provide 
.feedback.regarding.the.Enrichment.Program. -Approximately.208..234.surveys.were.distributed-(based 
on 16-18 students per session). Of these. 81 (38.94-34.62%) were returned which satisfies the 
minimum number of surveys required to assume that the'results are representative of all the parents of 
the students involved with the program. 
Measurq 

There were four primary purposes for surveying parents/guardians. The first was to solicit 
perceptions regarding major changes they observed in their child during the year and the primary 
impetus for those changes. The second is to evaluate communication between parents and the 
Enrichment instructors. The third purpose for administering the survey was tD solicit perceptions of the 
strengths and weaknesses of the PXQ9i:am.aod.to.obtain.parent.recommendations-for-improv8mentr-A-- 
fourth set of questions assessed the nature and extent of students* preschool experiences. These 
items were piloted for future use in a longitudinal study of all academic supporl programs in the district 
•and were not included as part of this evaluation. 
Procedure 

The initial distribution of the Des Moines Public Schools Parent Follow-Up Questionnaire for the 
Kindergarten Enrichment Program (see Appendix KE-E) took place during the spring parent/teacher 

^conferences.Jt.was.assumed.that-such-a-procedure-wouldincreasethelikelihood-ofresponse^^^^ 
however, a follow-up mailing was necessary to obtain an interpretable sample. 

Resiilts 

A number of the questions included on the questionnaire were open ended. To facilitate reporting 
these responses were categorized according to the general topic they addressee. In addition, the 
open ended format allowed respondents to list more than one response; therefore, the results were 
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reported in percentages based on the total number of responses rather than on the number of parents 
Of guardians who responded. Responses that appeared only one time and that could not be included 
in another cluster were combined in an "other category. 
Observed nhang>>s 

-Parents wereasked to describe-changestheyobservedintheir children since they began 
pariicipating in the Kindergarten Enrichment Program. Seventy-four of the 81 parents who responded 
(91.36%) provided 153 responses. Table KE-4 summarizes the nature of these responses. 

Table KE-4. Parent/Guardian Observations of Developmental Changes In Students Served in 

Kingergarten Enrichment 1987-88. 



Category 


Number of 
Responses 


Percent of 
Responses 


Individual Growth and Development 


82 


53.59 


Academic Skills 


53 


34.64 - 


Social Skills 


11 


7.19 


Other 


2 


1.31 


Negative Habits 


5 


3.27 



Over 50 percent cf the responses noted significant changes in individual growth and development. 
Twenty-one (25.61%) of these responses referred specifically to the development of a positive. attitude 
_towardscMolandJearningJn.generaLThese-types.of.responsesout-^ 
other categories. As "enthusiasm", "excitement for learning" and "curiousity" are characteristics of a 
"disposition for life long learning", these results provide some indication of the effects of this curriculum 
emphasis. Other frequent responses within this category included the development of self confidence 
(14.63%). independence (12.20%). and maturity (10.98%). Another 34.64 percent of the responses 
to this question included statements regarding development of academic skills. The most frequent 
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response referred to academic skills in general (20.75%); however, writing skills (13.21%). reading skills 
(13.21%). and counting skills (11.32%) were mentioned specifically. The third largest cluster of 
responses referred to social skill development including characteristics such as cooperation, the ability 
to interact well with other children, thoughtfulness and sharing. Five responses referred to the 
development-o* negative behavior patterns or characteristics. These included "bad habits" in general, 
"less self confidence", and "fatigue". 

When asked to indicate factors that would explain these changes, a majority of the parents who 
responded (64.56%) endorsed "participation in the Kindergarten Enrichment Program" specifically (see 
Table KE-5). Another 18.52 percent attributed these changes to a combination of factors including 
Kindergarten Enrichment, the regular kindergarten program, normal developmental changes and caring 
teachers. 

Table KE.5. Reasons for Changes Observed in Kindergarten Enrichment Students 

1987-88. 

___jCalegory_ Numberof 



, Percent of~ 
Responses Response 



ParticipationTn the ^IT" 

Kindergarten Enrichment Program 

Participation in Kindergarten Enrichment 8 im-i 
and the regular kindergarten programs 

Normal developmental changes 5 

Participation In the regular 5 

kindergarten program ^-^^ 



6.33 



2.53 



Participation in pre-kindergarlen experiences 2 

Participation in kindergarten programs and 2 o t:o 

norma! developmental changes 



Ail of the factors listed 2 
Other 



2.53 

^ 5.06 
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Parent/Teacher rftmmnnjf^f^tj^n 

The next section surveyed parent assessments of communications between program teachers and 
parents/guardians. A majority of parents (60.%) felt they received frequent notification of Kindergarten 
Enrichment activities. Another 32.50 percent felt they received feedback on a periodic basis. 
Combined these-data IrKJicate that 92.50 percent of the parents who responded to the survey felt they 
received information about the Kindergarten Enrichment Program on at least a periodic basis. 

Parents were also asked to indicate their perceptions regarding tf)e extent to which ihey received 
information about their child's progress in the Kindergarten Enrichment Program. Again. 92.50 percent " 
of those who responded felt that they received feedback on at least a periodic basis. Half of these 
parents felt that they received frequent feedback about their child's progress. 
Strengths. Wgp^nfffffiftfT- n pd Reftnmmftn ffationii 

Responses regarding the strengihs of the program fell into 2 major clusters: those that referred to 
the development of skills and attitudes necessary for success in the first grade and beyond (53.27%). 
^l^^^^' ""^9^^ specific chaVacteristics of lhe.piograi7i.(42.07.%)..Jrhe.nv)st.frequent-stren 



Sited within the "readiness" category included statements about emotional/atfiludinal development 
(22.81%). general readiness for first grade (19.30%). providing additional time and practice for students 
to learn (19.64%). generic statements about the support it provides to the regular kindergarten program 
(15.79%), and social skill development (12.28%). 

Teachers were the most frequerUly sited program characlerislic considered a strength of the 
program (37.73%). Smaller class sizes and their advantages also appeared frequently in this cluster 
(31.11%); as did sRecific aspects of the teaching methodology such as hands on experiences, 
focussing on the student's current level of functioning and providing a variety of concrete experiences 
(22.22%). 

Only 38.27 percent of the respondents listed specific weaknesses they perceived in the program. 
The category with the greatest frequency of responses included specific areas or topics that were 
mentioned only one time. Disappointment in the inability to serve more children and concern about 
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transportation logistics accounted for 19.36 percent of the responses. 

There was greater consensus among recommendations to improve the program. Approximately 30 
percent of the parents who responded to this question felt the program was fin6 as it was and could 
make no recommendations for improvement. Twenty percent of the responses to this question 
expressed a desire to see the program expanded to serve more kids in need. Another 15 percent of 
the responses expressed a desire to see greater teacher/parent communication and in particular 
communication pertaining to parent education and involvement in the educational process of their 
children. 

The fact thai respondents identified considerably more strengths than weaknesses or 
recommendations, and that no weakness was mentioned consistently among the responses suggests 
that parents were pleased with the program. 

CONCLUSIONS 

The results of the evaluation of the process and performance objectives of the Kindergarten 
Enrichment Program indicate that the program was implemented as outlined in the program description. 
Results of the Kindergarten Enrichment Student Evaluation suggest that students do develop in the 
areas specifically emphasized in the program. Placement recommendations at the end of the program 
support this perception and provide evidence to suggest that efforts to improve the placement 
procedures resulted in the identification of students that more accurately reflected the target population 
for whom the program was created. Although class sizes were generally lower than originally expected, 
they were maintained at a level that more closely approximated the ratio recognized as ideal for early 
elemental programs. Finally, parents/guardians of students in the program indicated that the 
Kindergarten Enrichment Program made a significant contribution to the development of a positive 
attitude toward school and the learning process. 

In many instances, performance exceeded expectations. For example, the performance objeblives 
specified thai 75 percent of the students served would be recommended for first grade at the end of 
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the kindergarten year. Actual figures Indicated that over 85% of Ihese students were considered 
adequately prepared for first grade. .Although instructors were only required to make one contact with 
the parents/guardians of students served in their classes. resuHs indicate that Enrichment teachers 
devoted a considerable amount of lime and energy keeping parents/guardians Informed of program 
activities and student development In the program. 

Combined results of this evaluation suggest that the Kindergarten Enrichment Program provides a 
unique experience to help prepare students with moderate developmental deficiencies for success in 
first grade and beyond. Implementation of the program accurately reflects its own philosophy as well as 
the philosophy of early elementary education In the district. 

RECOMMENDATIONS 
A preliminary examination of the impact of early elementary programs suggests that students with 
more severe developmental deficiencies might benefit from an additional half day experience In the 
kindergarten year. Accommodation of these students will require modification of the philosophy. 
Identification procedures, and the process and perro'm^ance'^bjectives of the Kindergarten Enrichment 
Program In 1988-89. The following recommendations are submitted for consideration in the 
modification process. 

1 . The program coordinator should work with representatives from the Department of Elementary 
Education to examine the philosophy statement underlying the early elementary programs In the district 
to ensure that il includes a rationale for the special programs at the kindergarten level. This rationale 
should also be rellected in the philosophy statement of the Kindergarten Enrichment Program. 

2. The program coordinator should work with the Coordinator of Testing and Research to develop 
kfenlirication procedures that accurately identify students most in need of academic support services at 
Ihe kindergarten level. 

3. The Inclusion of students with more severe developmental deliciencies will ellect expectations for 
the program;2.s "success" as measured by placement expectations at the end of the kindergarten year. 
In the absence of information on which to base sound expectations, the program coordinator should 
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esubnsh no more than 50 percent as the criterion level for this objective. This criterion should be 
increased gradually as the program adjusts to the changes associated with the new target population. 

4. The program coordinator should increase the criterion for parentAeacher contacts to more 
accurately reflect Enrichment teacher efforts and the emphasis characteristic of all Des Moines Plan 
programs. 

5. Although information from parents/guardians provides an important contribution to a program 
evaluation, the return rate of efforts to solicit such feedback is not necessarily in the hands of the 
program coordinator or teachers. The program coordinator should consider removing the 30 percent 
return rate criterion or eliminate the performance objective from the program entirely. 
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OBJFnTIVP.^ 

I Devetop personal social/emotional 
sWIfe to enhance self concept 
and self confidence. 

A. Devetop a sense of confidence 
and independence 

Student Demonstrates: 
1. Positive self worth. 
2; Feeling of accomp \;nment. 
3. Accepting/giving compliments 
and critidsms. 

B. Internalize sense of order. 

Student Demonstrates: 

1 . Understanding and foltowing 
classroom routines 

2. Respect for environment and 
materials. 

C. Dernonstrate social relationships 
and appropriate-social l)ehavior. 



Student Demonstrates: 
Interacting appropriately 
Participation and involvement 
Appropriate group behavior 
Exiting and entering conversations 
Accepting consequences 
Accepting/giving compliments 



1. 
2. 
3. 
4. 

5. 
6. 



SUGQFCTPf7/^()TIYITIFfT 

Superstar 
Self portraits 
Positive reinforcement 
Interviews 

Display student worit 
Me In A Box 
Use of developmental 
literature 



Daily planning 
Class rules/routine 
Classroom organization 



Role playing 

Stories 

Films 

Cooperative activities 
Collaborative experiences 
Large/small group participation 
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OBSERVARf P P| PMFNTfi 

Worthing independently 
Wori<ing cooperatively 
Interacting appropriately 



Orderly, purposeful 

classroom conduct 
Posted daily schedule 
Posted classroom rules 



Interacting appropriately 
Responding appropriately 
to teacher direction. 



OBJFnTIVP.<^ 



H Develop verbal fluency/competency 
through language experierKes. 

A. ^^Use/inlerpretation of oral^-^— 

language. 

Student Demonstrates: 

1. Complete sentences. 

2. Apprppriaje sentence structure. 

3. Descriptive language. 

B. jJse/interpretation of written 
language. 

Student Demonstrates: 

1 . Descriptive language. 

2. Representations of oral language. 

C. Demonstrate use of meaningful 
conversation. 

Student Demonstrates: 

1 . In small groups 

2. In large groups 

3. Through active listening 

D. BuikJ vocabulary 

Student Demonstrates: 

1. Naming- 

2. Categorizing 

3. Instructional language 




SUGGFSTPf^^rjIYITIpc^ 

Sharing 

Poetry 

Action songs 

Puppetry 

Dramatic Play 

Fonre of literature 

Modeling 

Brainstorming 

Rhyming 

Opposites 

Sequencing 

Stories 

Films 

Music 



OBSFRVAR! p PI F^^p^fT^ 

Complete sentences 
Remains on topic 
Use of related murtiple- 
sentences 



Use of related multiple 
sentences as displayed iu 
student work 

Naming 



Responds on topic appropriately 
Interacts on topic appropriately 



Listens attentively 
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Follows directions 
Categorizing 



OBJECTIVF<} 

in. Expfcre literature. 

A. enlarge vocabulary. 

B. Stimulate imagination. 

C. Develop listening skills. 

D. Broaden their view of the world. 



IV. Expand intellectual functioning and 
develop a disposition for life long 
learning. 

A. Thinking skills -DesMcines 
taxonomy. 

Student Demonstrates: 

1 . Problem solving-decision making 

Evaluate 

Synthesize 

Analyze 

Apply 

Comprehend 

Know 

Observe 



Identify with literature 

characters 
Dramatizing 

Introducing recommended 

quality literature 
Oral reading-teacher/std. 
Composition-teacher/std. 
Listening-group/station 
Use of various forms of 

print 

Altering story ending 
Sentence starters 
Records 
Films 

Rc!9 playing 



OBSFRVARt p Ft FVFM'^fT 

Individual reading centers 
Small group reading 

activities 
Large group reading 

activities 
Use of various forms of 

literature 
{See activities) 



Independent choices 
On task behavior 
Evaluating own work 
Group problem solving 
Appropriate'response to 
problematic questions 






- 




- OBJECTrVP55 


SUGGESTFDAnTlV|j(p<^ 


OBSERVARI P PI PMPMTC 


V. Integrate psychomotor sWIls into 
teaming activities. 

A. Develop gross motor skills. 

B. Develop fine nootor skills. 

C. Devetop body orientation - movement/ 
spatial orientatton. 


Hopping, skipping 
Running, galloping 
Dancing, rope jumping 
Carrying, sweeping 
Cutting, drawing, writing 
Pasting, cotoring 
Balance, walking downstairs 
Creative movement 
Catching, bouncing 
Patterning 


(See activities) 


VI. Demonstrate good health and safety habits. 






A. Health 




> 


Student Demonstrates: 

1 . Hygiene 

2. Nutrition 

3. Exercise 
4* Rest 

B. Safety habits 


Cooking, tasting, introduction 

to foods 
Appropriate clothing 
Hand/face washing 
Appropriate eating habits 


Self help J 

Posters 

Rules posted 

Cookfng activities 

Tasting activities 

Lunch time 


Student Demonstrates: 

1. Bus safety 

2. Classroom rules 

3. - Fire/tornado 

4. Playground safety 

5. Home safety 

6* Pedestrian safety 


Safe noute map 
Bus safety evacuation 
Fire/tornado drills 
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^ - t^tS-MOINES-pUBnCTCHOOLS ^' 

SCREENING FOR ENRICHMENT KINDERGARTEN 
TEACHER EVALUATION FORM 

Student K'ane 

"~ " ^School 

Teacher . 



Date 



CMld can reproduce « of 6 dap.Mng .patterns. 
s?nJfe"o";df?Ja?'?^;:.""^^^ P--"" two 
Urge ^ndfonows through in a 

"djor'groSp! '"P '^-ections. individual 

Child pays attention to ? short stnrv ,-n a „ 
9ro.P and can answer si^.pleUsUo^s\"bL 



*2. 

4. 

5; 



r.^ — 
c««t 



Visual Auditory totals 

^' of'Jtrrr';'""'""^ * sin,ple pu2zle 

: OT nve or more pieces. k^^^ic 



Visual totals 



^ Yes 

Child can, when shown a simple experience picture 
stole simply at least three variations of the 
activity portrayed in the picture. 

•2, Child can, when presented a simple nursery rhvme 
recite n accurately from 

•3. Child can, name 8 of 10. pictures, (objects. " 
people, animals, places) vuujecis, 

^. Child's verbalparticipation in a group is 
relevant to the task or topic. ^ """^ 

5. Child interacts verbally with peers and adults. 

6. Child verbally states, needs, (i.e. restroom, etc.) ~ 

7. Child- is easily understood by others 



CoriT.ent 



; ( , ^ ' Verbal totals 



r. 



«-ne e 



Jr/Ln -/^^^ ^ '""^^ balance beam-.tonward.-.back- 
Kard and-sideways in Fn integrated manner. 

\" ? ^^''""'^ direction a distance of 
10 .eet on the left foot and 10 feet on the right foot.. 

b^ti'^h.'L^c^^'S eight-inch ball in the air v/th 
tines ' " °" ^''''^ ^^"""^^ ^ °^ 3 • 

* 

Child can skip forward on alternating feet approx. 20 ft. 

fee^'^w??!; 'hiV?"" ^ ^^^P^ "^^'"9 alternating 

one hand '^'^ ^^^'^^"S ^ ^^^'^^'^S or holding 



e. Child can use scissors, paste and supplies functionally. 

^' frorf.t'" "'^'"■^"'^ color past the scribbling stage 

• tDepic'ts a person, incorporates body parts.) 
*-er.t 



CDir' Motor totals 

48 



Yes 



5:R££r.-ING FOR ENRICHMENT KINDERGARTEN. TEACHER EVALUATION FORM. p. 3 

Cr.ild attends to bask needs. (Clothing, toileting, 
cannc for personal possessions.) '■""«iing. 

2,. Child works independently at a task without 
indiviciual attention. 

JJ^JJr^g^^'^^^ appropriately to changes in the 
^* lellt without disrupting or bothering 

t- Child talies turns and shares with others. 
7- Child has positive attitude toward self .and school. 
Cornent 



Social/Self-Help totals 
(-indicates iter:s are included Vn the Wajpun" screening. 









< 

'4 


- 




J- 

( 
I 

?' 


Appendix KE-C 
Kinderoarten Fnrinhmftnt .^ti^^fint Evahjatmn 


y, 

24-30 

f 




* 


< 










50 





KIndorgarttn Enrlchmont Student Evaluation 

iotot^^^^^^^ ^"'^r?"^^' ^^^^^ this student 

oemonstratos at least age appropriate levels of the following characteristfcs: 



1 . Appropriate social Interaction with poors In small groups 

2. Recalls details from lnformatk>n presented orally 

3* Identifies Items (stimuli) with accurate and appropriate labels 

4. Spatial relations (external objects) such as: accuratoly 
estimates the space requirements for objects 

5. Recognizes the sequence and arrangement of an oral message 

6. Discriminates salient features of objects 

7. Actively pursues own IntellecluaUntorests 

a. Hygienic habits during food preparation activitfes 
9« Self assurance 

10. Appropriate sodal Interaction In a M situation with peers 

1 1. Eye-hand coordination without manipulatives 

1 2. Compliance with firo/Iornado drill emergency procedures 
13* Ability to analyze Information from the environment 

14. Enthusiasm for the learning process 

15. Appropriate games 

16. Observes safe playground behavior 

17. A sense of autonomy 

18. Remains on topic for the duration of a oonvorsation 

19. Incorporates now vocabulary words Into simple sentences 

20. Ability to synthesize Information from the environment 

21. Rhythmic activities 

22. Viewpoint or perspective 

23. Physical fitness 

24. Terminates a conversation with poors appropriately 

25. Moves at least Jwo parts of the body simultaneously wh. a 
standing In place 

26. Rocognizos the relationship between behaviors and their 
consequences 

27. Recognizes the consequences of hi&/her own behavior 

28. Accurately writes his^er own name 

29. Adequate rest 

30. Observes pedestrian safety conventions 



Infrequently 
1 2 3 



1 
1 

1 
1 
1 
1 
1 
1 
1 
1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 
1 
1 



2 
2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2< 

2 

2 

2 

2 



3 
3 

3 
3 
3 
3 
3 
3 
3 
3 
3 
•3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 



Frequently 

^ 5 r 
4 5 

4 5 



4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 



5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 



1 

1 
1 
1 
1 
1 



4 5 



2 
2 
2 
2 
2 



^ Student Name 



KE Center 



"51 



Session: am 



3 
3 
3 
3 
3 



4 

4 
4 
4 

4 



5 
5 
5 
5 
5 
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J^AL 



Curriculum EmphaMt 

1. Dwetop personal sodal/«molbnal skills to enhanci 
s«lf concept and self oonf idanca as avkJancad by 

1.1 OppoftunWas for indepandant and cooparativa 
actJVf(ias« 

1-2 Ofdarlypurposaful classroom conduct that 
conforms to classroom schadulas and standards. 

1.3 Appropriata Interactbn among pears and 
teachers during role playing activities, story lime, 
cooparalive activities and other classroom activities. 

2. Develop verbal f luency/competency through a 
variety of language experiences such as sharing, 
poetry, action songs, puppetry, dramatic play, 
opportunities to interact with various forms of literature, 
modefing, brainstorming, rhyming, films, music, eta 
stressing concrete, student-centered vocabulary. 

3. Expand intellectual functbning and develop a 
dispositbn fpr life tong learning through activities 
such as indivkiual and group problem solving and 
opportunities for free chobe time. 

4. Develop psychomotor skills by integrating fine ' 
motor, gross motor, and spaiial orientatbn activities 
into the learning process. 

5. Devetop good health and safety habits through 
lessons in hygiene, cooking and tasting activities, 
and safety drills. 




KINDERGARTEN ENRICHMENT 
Observation Checklist 1987-88 



GOAL 



Mattrlals and Equipmtnt 

1. A varwtyot teaming activity cohtorsiricfuding 
but not limitad to reading canters, listening centers 

play house, and areas to participate in hands-on. 
manipulativa activities. 

2. Areas for sman and large group activities. 

3. Suffident materials for a variety of hands-on 
manipulative activities. 

f Materials to provide a language enriched 
environment such as various forms of literature and 
language (i.e.. posters, labels, books, papers, and 
magazines), records, record players, cassette players 
and composition boards. 

Program Management 

1. Daily planning as evidenced by accessible daiV 
lesson plans. ' 

2. Monitoring student daily vrork as evidenced by 
public display of student work and maintaining 
indivkiual files of student progress. 

3. k7aintaining program records such as the End of 
the Year Feedback Form and the Parent Contact 
Summa^ Form. 



KINDERGARTEN ENRICHMENT 
Observation Checklist 1 987-88 



OBSERVED 



NOT 
OBSERVED 



DISCUSSED 
W/TEACHER 



REVIEW 
RECORDS 



COMMENTS 
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DES MOINES PUBUC SCHOOLS 
PARENfr FOaOW UP QUESTIONNAIRE FOR THE 
KINDERGARTEN ENRICHMENT PROGRAM 



1. School at whfch your child p artidpaled/in Ihe m^iarmcimmjl program 

Progra m ' ""^"^ "^"^ Participated in ihe imsiQanmEnikhnm 

3; Describe ar^y major changes that you have observed in your child since he/she started school? 



tli^^llT'''' "'"^"'^ ''''' ^^^"9^^ ^P'^^^e Check only one of the following 



a. 



.Partclpdtion in pre-kindergarfen experiences. 



Parlicrpafion in the regufar kindergarten program 

J- ^Panicrpaifon in Ihe Kindergarten Enrichment Program 

°- .Normal devetopmenfal changes 

.Other (pfease specify) 



5. How often were you informed of Kindergarten Enrichment fldiyjlies? 



a. 



Frequently 




b. ^ Periodically 

c. Rarely 

. I was not informed 

3- Frequentfy 

b. ^ Periodically 

c. f^arely 

. \ was not informed 

7. Did your child atlend preschool? Yes No 

'!!!:TJ^;t;nsSr"''''''^""''^ W.o,od,.yourc;«a„cn,p,oschoo,T 

Rubliclv.fund,-d "° "'"^ '°' ""'"^ a'"- I' 

T •,• u SO, whore? 

Tuition-basGd . ."••7 - • 

1_ Other (Specify) "owa. but no .n the G.oaler Des 

Hoadslart " ^''c^e?. 

Oon'l know ^'^^^^^ 



5S 



(OVER) 



SSI^ ' ''''''''' ^'^ many days per week did your child attend 

Full-day P^'^'^^'^ 

2 



Half-day 

Before and after regular working 3 r^— ^ 

hours or daycare 

How many years did your child attend preschool? 

Less than e months 

6-12 months 

__ 13-18 months (ltoM/2 years) 

19-24 months (M/2 to 2 years) 

More than 2 years 



8. What do you believe to be the strengths of the Kindergarten Enrichment Program? ' 



9. What do believe to be the weaknesses of the Kindergarten Enrichment Program! 



10: What reccmmendations do you have to Improve the Kindergarten Enrichment Program! 
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INTRODUCTION » 
Background Information 
In 1985 the Des Moines Independent Community. School District began implementing a 
comprei.anslve Plan For Excellence to improve the academic achifivement of all students. One 
component of the Plan For Excellence emphasizes improving achievement specifically for low achieving 
students. A key assumption underlying this area maintair.o that early identification of potential learning 
deficiencies and intervention, maximizes the likelihood of academic achievement and reduces the need 
for future remediation. Therefore, special efforts were made to develop and strengthen identification 
and support services at the primary (K-2) level. 

Early idpoufication begins during kindergarten screening which occurs three weeks into each 
academic year. At this time students who demonstrate moderate developmental deficiencies are placed 
in the Kindergarten Enrichment Program, a half day supplemental program designed to reinforce, 
without duplicat:n2.'the regular kindergarten curriculum. Students who demonstrate more severe 
developmental deficiencies benefit from the interaction with peers of a variety of developmental levels 
in the regular kindergarten program and may be given an additions! year of reinforcement in the K-1 
Transition Program the following year. 

The K-1 Transition Program was piloted during the 1986-87 academic year. Another provision of 
•he Dos Moines Plan For Excellence calls for coordinating all academic support programs in the district 
under one umbrella organization. This coordination was phased in during the 1987-88 academic year 
under the Des Moines Plan: A Plan for Student Success. Capitalizi.'^j on the successful objectives 
based structure 'of the district's Chapter 1 Program, the Des Moines Plan required each academic 
iVupport program to prepare perfonnance objectives for administration, students, instructional -'aff. and 
the parents/guardians of students in the program. Objectives for the K-1 Program were prepared and 
Implemented in 1987-88. The primary' purpose of this evaluation is to document the extent to which the 
K-1 Transition Program was implemented according to these objectives. 
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,f. Program Description * 

Genoral nflsrrip{ipn 

The K-l Transitional Program was developed hy^ a commiltee.of elementary school .' dministralors. 
teachers and the districfs Supervisor of Reading in response to a perceived need among a significant 
number of students for additional instruction in academic, social, physical, and emotional development 
before entering the first grade. The K-1 Program provides full day. comprehensive inUruclion in all 
subject areas represented in the regular first grade, as an extension of the kindergarten curriculum. 

Adminifitratihfi 

. The program was coordinated by the districfs Supervisor of.Reading and ar. elementary school 

principal. The K-1 teachers met with the coordinators monthly to discuss curriculum and p.ogram 
issues. An evaluation corfimittee was also created to critically examine various aspects of the program. 
This committee included the coordinators and teacher representatives from first crade. kir.dergarten 
andtheK-1 Program. 

Mcn dance Centg rg 

Eight K-1 centers were established at elementary schools thro-jghout the district. Rrooks. Findley. 
Greenwood. Jefferson. King. Moullon. Willard. and Woodlawn Elementary Schools wore selected on 
the basis of available space and transr rtalion logistics. Approximately 1 20 students woro served 
across all centers. The average class size across centers was 12-15 students. 

BydflClJsndJIxpjJJKiilures 
As a pilot, the K-1 Transition Program was funded through allowable growth funds .iwaided to the 
district for the Education Improvement Program Grant (i.e.. the Plan for Excellence). A- inrt of the 
Des IVIoines Plan, the K-1 Program was funded through federal, slate, and local souu..-.s. Federal funds 
were provided.through the Chapter ! Program. A slate contribution was provided Ihrour,!, the Education 
Improvement Program Grant. Local monies for transpcrMlion and the Volunla/y Tran:.;.... Program were 
■jHH^ also allocated to the K-1 Program. 

Table K1-1 lists the budget and expenditures for the program. Budget figures •.. - . . ..:.i:iiated on 
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the basis of district averages. The average teacher salary for 1987-88 was $26,389. Estimated salaries 
and benefits for eight full time Instructors was $211,112. Each building received $24.10 per student for 
supplies and materials. Multiplying this figure by the average number of students s-.rved during the. 
academic year (1 1 o) provides an estimate of the budget requirements for the program. Transportation 
demands were estimated by multiplying the average cost per student in 1987-88 (I.e.. $155.54) by the 
average number of students served during the year. 

State and federal regulations prohibit intermingling of funds, therefore, expenditures are reported 
according 10 the funding source. Expenditures for supplies and materials were recorded for early 
elementary programs comb ined. The figures. listed w ere estimated on the basis nf ihp n..m.,er 
of students in the K-1 Program. Transportation expenditures wefe credited to the district general fund. 
Actual expendilures were, therefore, not available specifically for.'ihe K-1 Program. 

The estimated total expenditures for th? program representf; an over expenditure of approximately 
10 percent; however, the number of estimated figures in the table challenges the validity of this budget 
review. Current record keeping procedures, complicated by the numbfcr of funding sources and 
associated accountability stipulations, failed to provide clear evidence of the actual budaet and 
expenditures. 

Table K1-1. Estimated Budget and Ependitures for the K-1 Transition Progrsm 

1987-88 

Salary/ Supplies/ V'ansDortatfon Total 

BerieOlS Materials 

^"^9"' $211,112 $2^651 $T7J3i $i5^2 



$77,791 



Chapter I $77,313 $478 
Education 

Improvement $101,881 $478 $102,359 

District $53,439 $17,131 $75570 
Total 

Expenditures $237,633 $956 $17,131 $255,720 
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Phiiosophy * 
The phitosophy of. the K-1 Program is based on accepted principles of growth and development. 
While it Is assumed that all children can lea:n. the philosophy of the program recognizes that children 
through approximately age 7 develop at variable- rates and may not be developmentally prepared to 
meet the challenges of first grade by the end of the kindergarten year. The goal of the K-1 Transition 
Program is to reinforce and expand the social, physical, academic, and emotional growth achieved 
during kindergarten through the /application of these principles of growth and development. 

Curriculum 

The-K-1Transition-Program has-a-oomprehensive curriculum that includes speclffc 



performance objectives for physical education, art and music activities, and social emotional 
development in addition to the traditional academic areas found In the regular kindergarten and first 
grade-fiurrlcula (see Appendix Kl-A). Strategies in Early Childhood Education (Waupun). Mathematics 
Their Way. and Workjobs I and II are locally developed and commercial curriculum packages that were 
adapted and employed.to enhance the K-1 curriculum. 

lnstructiona lTechniq riP«^ 
The Instructional strategies employed In the K-l Program reflect early childhood principles of 
learning. Techniques emphasize concrete subject matter and provide opportunities for hands-on 
experiences. For example, math paltems and concepts are demonstrated with concrete materials and 
problem solving techniques that require children to manipulate materials. Oral language and literature is 
emphasized by providing students an opportunity to participate in language experience stories and to 
explore children's literature. A variety of methods and techniques are incorporated to encourage 
problem solving and to practice expressive language. 

Identifir. .1 ProRfirinrA ^ 
Students served in the K-1 Transition Program In 1987-88 were identified durino the second 
semester of their kindergarten year. Students who completed less than 80 percent of the entry level 
objectives of the kindergarten curriculum (i.e. Level III of Waupun) by January 1987. were evaluated with 
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the Kindergarten Checkpoint in January and again in May (see Appendix Kl-B).. Students Who failed to 
earn a minimum of 17 points on both administrations of the ci.sckpoint were referred for placement into 
the program. Students new to the district in 1987-88 were evaluated with the Kindergarten Checkpoint 
upon request by the regular classroom instructor. Selections were validated with the results of the 
Metropolitan Readiness Test when questions were raised about the appropriate placement of students. 
Final placement was contingent upon consent of the parent or,guardian. 

Exiting Pfr>nP(fnrfts 

Students could be exited from the program In three ways. Teache.^. the principal, parents or the K- 
1 cogrdinator couldj-equest a.re-evaluation during the first nine weeks of the K-Tyear. If the results of 
the re-evaluation indicate that the child satisfied the prerequisite skills considered important for success 
In first grade, the student was placed in a first grade classroom in his/her neighborhood center. 
Students could be referred for staffing into a self-contained special education classroom at any time 
during the year. Finally, all .tudenis who completed the K-1 Transition Program were enrolled in the first 
grade in their home-school for the next academic year. 

PROCESS AND PERFORMANCE OBJECTIVES 
Introduction 

Process and performance objectives were generated in four major areas '.o guide the 
Implementation of the program. These areas include: administration, students, instnjctional staff, and 
family. The methods for documeni:ng and evaluating each objective in these areas, as well as the 
results of the evaluation, are described below. 

Administration 

4 

■Obieclive B-j 

During the instructional year the consultant will organize and maintain an accountability file a^:d 
provide copies of data to support the evaluation of all objectives as documented by accountabili:y files 
maintained by the program consultant. 
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Evaluation M<^\i]^ * 
Evaluation of this objective called for simply confirming the existence of,accountabllify files. 
Maintenann was monitored by requesting information as specified in the program objectives. 
^ . BfiSullS 

The program evaluator confirmed the creation of the files and received all data in a timely fashion as 
specified in the program objectives. 

Students 

Objective A-l 

tn January of 1989, at least 60 percent of those students who were served In the K-1 Program for at 
least two thirds of the previous year will receive a passing score on the first grade checkpoints as 

documented by first grade checkpoint scores on file In the Department of Evaluation, Research, and 
Testing. 

Evaluation MAtl^ pf} 

Although checkpoint re.-uHs for students sensed in the K-1 Transition Program in 1987-88 will not 
be available until 1989. the results for students sensed in 1986-87. who completed the checkpoint in 
• -January of 1988. are presented below. Those students who attended less than two-thirds of t.h9 
scheduled academic year were omitted from the analysis: however, records indicated that no student 
was omitted on the basis of this criteria. 

A major component of the identification procedures for the elementary and secondary program- in 
the Des Moines Plan involves the district's checkpoint program. Mid year mastery of curriculum 
objectives in reading, writing and math are assessed In grades 1. 3. 5, 8, and 11. These grades 
represent key transition points in the educational experience in this district. Students who fail to satisfy 
minimum standards of performance in these areas are considered for assistance in the Des Moines Plan 
Lab programs. 
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• Student scores are reported in three bands: the range of -definite need" includes thcle students 
Who scored well below district staridards and who were f irst^to receive assistancMn the fab programs. 
Students who fell within the "range of reconsideration- were served according to need as space was 
available in the (ab programs.. All other students \satisfied district standards. 

The bands were determined on the basis cWhe distribution of checkpoint scores and on district 
resources. Consistent with the philosophy of the Des Moines Plan, greater emphasis was given to 
serving students at the elementary levels In the distribution of resources. For example, provisions 
include serving 20 percent of the students In grades 1 and 2. 15 percent In grade 3. 10 percent In 
•grades 4-6r8 percent In grade 7 and 5 percent In grades 8-11. 

In 1987-88 the first grade students who scored below 62 percent on the math checkpoint or below 
48 perceTit on the reading checkpoint demonstrated -definite need" for academic support. Students 
Who scored between 62 percent and 77 percent on the math checkpoint and between 48 percent and 
68 percent on the reading checkpoint (ell within the range of reconsideration. Students who scored at 
or above 77 percent on the math checkpoint and at or above 68 percent on the reading checkpoint 
satisfied district minimum performance standards. 

The philosophy underlying all early elementary programs is to provide a strong foundation in the 
academic skills necessary for success In schoci and therefore minimize the need for future remediation. 
The extent to which students qualify for additional academic support services then, has implications for 
the success of the program. 

Result^ 

Scores on one or more of the checkpoints were available for at least 81 percent of the students 
served in the K-1 Program in 1986-87. The distribution of scores for both reading and math ar2 
presented in Table Kl-2. These results indicate that approximately 52 percP-,1 of the students who 
were served i.n K-1 passed the reading checkpoint; however, only 25 percent of these students passed 
the math checkpoint. The rfc.naining students scored within the lowest 20 percent of the distribution of 
all first gradis students. 
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Table K1 -2. Distribution of Math and Reading Checkpoint Results ' 

1986-87 K-1 Students. 

Test Passed Reconsideration Definite Need Total 

Number Percent Number Percent Number Percent Number Percent 



Reading 65 52.42 42"" 33787 "" I7"" ll.71 T24 100.00 
Math 30 25.00 55 45.83 35 29.i7 120 100.00 

Although the results fail to satisfy the program objective, they shouW^be interpreted with the 
following considerations. First, {hese data are the results of students., who were served in the initial year 
" of lmplemenlaifon and nriay lj^refo7e1n<^t"rifrect'the true impact of the program. Second, the criterion 
was established without the advantage of baseline infomiation on which to base reasonable 
expectations for success arid may therefore be unreasonably high given the population being served. 
Third, although the results were lower than expected, the number of K-1 students who failed to satisfy 
district standards represents less than 4 percent of the population of their same age peers {specifically 
2.27% and 3.46% on the reading and math checkpoints, respectively). Finally, the discrepancy 
between scores on the reading and math checkpoint suggests that greater emphasis was placed on 
reading and language experiences in the program than on math skills which is consistent with the 
primary thrust of the program. 

Instructional Staff 

ObiectivR R-l 

During the instructional year K-1 teachers will develop and maintain a student checklist for each 
student as documented by the presence of such lists on file with the K-1 teachers. 

Fvaliialion Mfithprj 

Moasnrt* 

The curriculum objectives for the K-1 program wore arranged on a form to facilitate monitoring 
student progress (see Appendix K1-C). The form lists the objectives aIonp;\he horizontal axis and the 
student names along the verlical axis. Student progress on each objective .Is recorded in the grid that 
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results When these axes Intersect. Teachers use a code system to denote progress on eat^h objective. 
A diagonal slash irxJicates that the objective had been introduced and a second slash in the opposite 
direction Indicates that the objective has been successfully mastered. 
Procedurfl 

Maintenance of these records was confirmed by the program evaluator during onsite visits that took 
place In the spring of 1988. 

BfiSuJlS 

Curriculum objective documentation forms were readjly evidenced at all centers during the onsite 
Visits .nd appeared to be updated on a regular basis.'to reflect the student's current level of functioning. 

Obiectivft R.2 

During the instructional year K- 1 teachers will instruct an average of 12- 15 students daily as 
documented hy class lists compiled from student data forms, submitted to the program consultant by 
September 18, 1987. 

Evaluation Mftlhff^ 

Class lists appeared =n the records for each of the attendance centers by the September deadline. 
To get a more accurate representation of the slabilrty of the student/teacher ratio across the year, class 
sizes from the beginning of the year were compared to class sizes at the end of the year. 

Results 

The results indicate that the number of students per K-1 Transition center ranged from 10 to 17 with 
an average class size of 13.5 at the beginning of the school year (see Table K1-3). Class sizes ranged 
from 1 1 to 1 7 and averaged 1 4 students by the end of the school year. This suggests that class sizes 
remained fairly constant and within the criteria specified in the objective. 

Table K1-3. Class Size Statistics for the K-1 Transilion.Rrogram 1987-88 

Timeof Range Average 
Pecoiding ^ 

Fa" 1987 10-17 

SDrinn19fifl ^^.17 ^ 
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Obiectrve R.1 * ' 

By the end of the second semester. K-1 teachers will have had at least one contact with the 
parentis) or guardians) of each student enrolled during the inrructional year. These contacts may 
- -consist'drom dFifnre of the following: a) Parent/teacher conferences: b) K-1 newsletters: c) K-1 open 
houses: ord) Parent volunteer activities, as documented by attendance reports, copies of newsletters 
or other appropriate forms of documentation submitted to the program consultant by May 15. 1988. 

tEvatuation MPt^^off 

To facilitate documenlation. teachers were asked to maintain records of their conta-ts with parents 
throughout the year. 
Measure^ 

Initially, teachers recorded their contacts on the bes Moines Plan Educational Plan Summary 
Report Form that was developed for the Chapter I Reading ano Math Labs (see Appendix K1-D). 
Differences between the lab programs and the K-1 Transition Program rendered a number of the items 
on the form irrelevant. In February of 1988 a revised form was introduced as a more appropriate form of 
documoritation (see Appendix K1-E). 
Procediiffis 

Teachers were given the option to use either form for the remainder of the school year. Each 
teacher maintained a file of these forms and submitted Ihem to the program evalualor in May of 1988. 

Re sul ts 

The very structure of the program provides ample opportunities to satisfy this objective. All K-1 
Transition centers invite parents to attend an open house to answer questions and to familiarize them 
wiih the pr:DOram. In addition, parent/teacher conferences are h 2ld once in the fall and once in the 
spring to discuss student progress during the year. Finally, K-1 Transition instructors are encouraged to 
prepare and distribute periodic newsletters to keep parents/guardians abreast of.K-1 Transition 
activities. The number of contacts structured into ihe program increases the likelihood that all parents 
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werk^pntaded at least once duri, ig the school year. * 

Teacher records^ provided a more accurate description of the efforts made to contact 
parents/guardians. The results of the parent contact record forms indicate :hat all teachers prepared 



Parents were also kept informed of their children's progress in the program. Estimates of the 
number of individual notes, piibne contacts, and personal contacts Initiated by K-l Transition teachers 
are reported in the Table K1.4. A number of teachers incorporated rwtes to parents into their classroom 
management strategies. Feedback reinforcing positive behavior arxi/or idenufying areas for 
improvement were sent home on a daily basis for select students. /.ShoUgh there is no information 
available to compare these results to efforts made by regular kindergarten f.nd first grade teachers, the 
results do suggest that K-1 teachers considered communication with parents or guardian, an important 
component of the progam. 

Table Kl-4. K-1 Parent/Guardian Contacts 1987-88 



Type of 
Contact 


Total 
Contacts 
Fan 


Average 
Contacts 
Fall 


Total 
Contacts 
Spring 


Average 
Contacts 
Spring 


Phone Contacts 


190 


27.14 


■ 190 


27.14 


Individual Notes 


68 


8.50 


1671 


208.88 


Personal Contacts 


184 


23.00 


166 


20.75 



Family 

the end of the instructional year at least 30 percent of the parents of K-1 sM^^^ 
formative feedback on program activities as documented by a summary of responses obtained from a 
parent survey conducted by the program evaluator. 
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Evaluation MftthOfI ' 
„_Becausej>fjhe.limlted,number.of.sludents served in the program (l;e.. approximateri12). ail 



parents were surveyed to increase the chances ol obtaining a representative relum (30%). 
Measure?; 

Feedback from parents was solicited on a brief Parent Follow Up Questionnaire (see Appendix K1 - 
F). The questionnaire contained 4 open ended questions regarding the changes parents observed in 
their children during the K-1 Transition year, and the strengths, weaknesses, and recommendations for 
the program. 
Proceriiiffts 

The initial distribution of the survey took pface during the spring parent/teacher conferences. It was 
assumed that r :a procedure would increase the likelihood that parents would retum the completed 
fomi: however, a follow up mailing was necessary to improve the return rate. Combined, the retum rate 
from both methods of distribution (26.79o/o) failed to yield a sufficient number of surveys to interpret the 
results as representative of all parents/guardians involved with the program. Therefore the following 
results must be interpreted with caution. 

Results 

Open ended questions =nvited respondents to list multiple responses to each of these questions. 
To facilitate reporting, all responses were coi-nted independently and were categorized according to 
the general topic they addressed. Responses that appeared only one lime and that could no! be 
included in another category were combined lo form an "other category. 

Responses to the question regarding the nature of the changes parents observed were classif.ed 
into ewcmajor categories (see Table K1-5). About one half of the responses referred to developments 
-in specific academic skills such as writing (18.75% within this category); reading (18.75% within this 
category): fine motor (15.625% within this category); and learning skills in genera! (12.50% wilhin this 
category). 
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Table K-t 5. Differences Observed In !M Students byTheir Parent/Guardian 



Pe/cent of 



Ca'egoiy Number of 

Responses Responses 
Academic Skills 32^ 

Social/Emotional 27 

Negative Habits 1 



Total 



53.33. 
45.00 
1.67 

60 100.00 



Another 45 percent of the responses referred tc social/emotional developments. The most 
frequent resporrse wfthin this category noted the development of a positive attitude toward learning 
:(15.56%). The remaining responses referred to positive emotional growth such as self confidence, 
independence, increased self esteem, maturity, getting along with other students, increased patience, 
etc. One parent mentioned the development of negative behavior patterns. This parent felt that his/her 
child became "nwuthier durinq the course of the year. 

Table K1-6 lists the resr?nses to the question regarding parent perceptions of the strengths of the 
K-1 Program. These responses clustered -.to three general categories. The greatest percentage of 
them (54.17%) referred to specific aspects of the program. Over one third of the responses within this 
categoor (38.46%) credited the teacher as the strength of the program. Approximately 19 percent of 
the responses within this category listed class size and aspects of the curriculum among the strengths 
of the program. The remaining responses included: the full day experience (7.69%). the teaching 
method (7.69%). a less stressful climate (3.85%), and the emphasis on parent Involvement (3.85%). 
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Category 


Number of 
Responses 


Percent of 
Responses 


Program CharacJerisics 


26 


54.17 


Program Purposes 


11 


22.92 


Curriculum/Program Goals 


10 


20.83 


None 


1 


2.08 


Total 


48 


100.00 



Arwther 22.92 percent of the responses clustered around the basic purpose of the K-1 Transition 
Program. Among these included: -gets kids ready for first grade" (63.64%).;-help(s) kids who are slow 
and would not get the help they ri-edsd (had) they gone on io first grade" (27.27%). and ^providing 
additional time for students to grow up^bt.j.e etiterihg the first grade" (9.09%). 

The third category included responses that referred to specific aspects of the curriculum or areas 
emphasized in the program (20.83%). Half of these referred to the focus on specific academic skills. 
The other half referred to the attention to social/emotiotjal development. 

Only 28 replies were reoo/ded in response to the question regarding weaknesses of the program. 
The most frequent response-among these was "None" (39.29%). Weaknesses that were listed varied 
widely and were mentioned'by three or fewer respondents. The iimited number of responses to these 
questions, as well as the inconsistency among specific weaknesses identified, renders these results 
unint'^rpretat'i). ' 

Similarly, only 31 repfies were i-ecorded in response to the question soliciting recommendations to 
improve the program. Approximately one-third of the responses (i.e., 32.26%) could make no 
recommendalion to improve the program. Ar;other one-third of the responses appeared only one time. 
Four responses offered suggestions to alter the kindergarten program so as to avoid or reduce the 
need for.a K-l Program. These Included providing an all day kindergarten program, particularly to those 
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-Students who c'id not have a\veschool experience, and reducing the class size in the regular 
kindergarten classrooms. 

CONCLUSIONS 

■In general; the results 5Tan examlhaUon of theprocess objectives suggest that the K-1 Transition 
Program was implemented as oultined in the program description. Teachers followed objectivos to 
provide a complete curriculum. They also made considerable efforts to keep parents and guardians 
informed of their childrens* activities and progress and encouraged their active involvement in the 
development of their children. 

Although a review of the performance objectives of the program failed to satisfy expectations, the 
■quatifi^cations that mfst be imposed on the interpretation of the results renders them preliminary at best. 
Checkpoint resuH^ do indicate that the program is approaching the criterion level for -success" 
particularly in the area of reading. Finally, while the return rate was insufficient to considerthe responses 
as truly representative, there is reason to believe that parents and guardians of student.c/in the program 
are pleased with the impact of the program on their children. 

RECOMI^ENDATIONS 
A preliminary examination of the impact of early elementary programs on student achievement 
suggests that student.«^ with more severe developmental deficiencies might benefit from an additional 
half day experience in the kindergarten year. Participation in this supplemental program could change 
the nature of the students served in the K-1 Transition Program and may therefore, require modification 
?n the pros.-cm to better meet the needs of these students. The following recommendations are based 
on the results of this evaluation with consideration of pending alterations in the organizational structure 
01 the early elementary academic support programs in this district. 

1 . The program coordinator should work with represe.n.tativesjrom the Department of Elementary 
Education to examine the philosophy statement underlying all earJy elementary programs in the district. 
Particular attention should be directed to ensuring that the rationale for the early elementary support 
programs are consistent with the philosophy of the regular kindergarten program. 
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2. The program coordinator should work with the Coordinator of Testing and Research to examine the 
impact of the structural change on the Identification procedures forthe K-1 Program. Necessary 

. .i^'^^'l''^-^"' ""^"^^ '° ensure that the most appropriate students are Identified and served. 

3. The additional half day experience during the kindergarten year Is likely to Increase the -success" of 
the K-1 Program as meastjred by first grade checkpoint results. However, as students served in the K-1 
Program are identified In the spring of the kindergarten ye.ir. the effects of this structural change will not 
be experienced until 1989-90. Giveh the results of.this evaluation, the program coordinator should 
reduce the criterion level for passing the first grade math and reading checkpoints to .no more than 50 
percent for 1988-89: 

4. The first grade checkpoint results suggested that considerably more emphasis Is devoted to the 
development of reading skills than math skills. Given that the K-1 Program Is designed to provide a 
comprehensive curriculum, and that the performance objec'i.e to determine the "success" of the 
program Includes the results of the math checkpoint, the program coordinator should work with K-1 
teachers to increase the emphasis on math skill development. 

5. Current outcome measures to evaluate the effects of the program ar ^ limited to the first grade 
check.ooint results. As these are not available until the year following the current year of service, they 
are of limited value in the evaluation of the immediate yekr of service. The program coordinator should 
work with the program evaluator to identify means of providing more fomiative f eedba:k of the effects of 
the program. 

6. The program coordinator should increase the criterion for parent/teacher contacts to more 
accurately reflect the efforts of the instructors and the emphasis characteristic of all Oes Moines Plan 
programs. 

7. Although information from parents and guardians provides an important contribution to the program 
evaluation, the retum rate from efforts to solicif such feedback is not necessarily in the hands of the 
program coordinator or teachers. The program coordinator should consider removing the 30 percent 
return criterion or eliminating this performance objective from the program entirely. 
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Appendix K1-A 
K-1 TransHion Cu rrifjiilt im Objfirtivfi s 
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K-1 TRANSITIONAL CLASSROOM r 

Objectives 

LEVEL III REPRESENTATIONAL 
-LEi^ELJU- CRITrCAi:THIMKlKlft«;K|ij<^ 

T1. Child can identify^absurd elements in a picture. 

T2. Child can dravy^ picture showing their own ending of an orally presented story. 
, T3. Child can draw a picture showing the main idea of an orally presented story. 

LEYELJIl VISUAt, 

When given a key picture, child can find pictures that are associated with it 
(Example: boots, umbrella, raincoat, etc.) 

^ !I!.£Hlf/^"f'/l°"' ^ "^'""'^"^ background, outline with finger or pencil six of ten items 
regardless of their size or position. 

•3. (2) Child can fomi five figures by connecting dots which are given as contextual clues. ' 

•4. (3) Child can visually discriminate similar objects in nine of ten exercises. 

5. Child can piece together a 12-14 piece puzzle. 

6. Child can match an isolated alphabet letter to the correct letter from an array of 3 letters. 

7. Child can match an isolated numeral '.r^^u^. r^trea numeral from r.n array of 3 numerals. 

8. Child can recognize first name in lower case letters (Jane). 
T. 9. Child can recognize a letle ■ from a group of symbols. (2. b. triangle) 

lEVEI. Ill AUDITOR Y 

CI . Child can. upon hearing an instrumental sound on tape, find the corresbondino instrument 
(drum, triongle. blocks, cymbals, tamborine. bells) rresponaing instrument. 

C2. Child can identify two sounds as the same. 

C3. Child can identify two sounds as different. 
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*S. (2)'Child can reproduce 4 of 6 clapping patterns. 

6. Child.can identify an object in response to the sound it makes 4 of 6 times. Use wfiistle ball 
walking, music, telephone and engine noise. ' ' 

7. Child can carry out 3 related directions in sequence after hearing once without further clues. 

8. Child can carry out 3 unrelated directions in sequence after hearing once witfiout further clues. 
^' "^rUagic-^word)'"''''' ^^'"^ ^ °^ ("^"^^"^'^e^'ns ^ ""^yslery" word or 

■ :iO. (3) Child can. when given a simple word, produce 2 simple words that rhyme. 
Til . Child can repeat 4 one-syllable words. 
T12. Child can repeat 4 digits in sequence. 



LEVEL til MOTOR 



1. 



3. 
4. 



Child can maintain static balance on right foot for 5 seconds and left foot for 5 seconds 
(Activity buildups; tiptoes, standing, kneeling, sitting with feet off ground, arms out.) ' 

(1) Child can maintain flexible balance of body when walking across a 10 foot 2 x 4 inch 
balance beam IfiDjiard. backward, and side\yays in an integrated manner. 

Child can gallop forward aiong a 30 foot 12 inch wide path wilhoui stepping off. 

Child can throw a ball and hft a two-foot wide stationary target 3 of 4 times by using a two 
handed underhand throw from a stationary position 6 feet away. 



5. Child can throw a bean bag into a v/aslebasket six feet away 4 of 5 times. 

6. Child can catch an eight-inch ball on the fly thrown from su feet away 3 of 4 times. 
2^ofTtlmS" ^" ^''9h\-\nch ball in the air with both har ds and catch it on the first bounce 

8. Child can kick a moving ball at least 6 inches, rolled from 10 feet away. 

9. Child can fold 9x12 inches paper in halves and quarters. 

4 

(4) Child can dfaw.;^ line between two boundary lines approximalely>3/8" apart. 

11. Child can copy a square. Irianr'e. and X. 

12. (5) Child can skip forward on alternating feel approximately 20 feet. 

13. Child can write first name in manuscript using lower case. - (Don) 
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3. 
4. 



LEVEL HI VERBAL 

f 

1 . Child can verbalize sentences that !^,.'o a descriptor (adjective), noun and verb pattern by 
responding appropriately to a stir.i 'us picture when asked. ""VVhat is happening in the picture?" 

2. Child can use the pronouns she, ho. they, appropriately. 
Child can name eight cqlors. (red. b!:)0. yellow; rreen. orange, purple, black, brown) 
Child can name all body parts, in^i.^'ing fingers, toes. neck, shoulders, elbovvs. heel, wrist, and 

C. 5. Given t>vo sequence activities, the c'-;:d will vert>aiiy, predict the third sequence. ("Mothor cooks 
the hoii, then sets the table, what will happen next?) 

6. Child will supply a logical third step lo a three step sequence activity 2 out of 3 times. 

C * 7. (1) Child can. when shown a simple ^p.-ric-nce picture, state simply at least three statements 
mat describe the activities portrayed in the pi-^ture. 

8. Child can irriitate th;, action of the to.-.cher and verbalise on hi./hprnwp the following spatial 
concepts, (far. beside, below, low. L\.-!!om, behind, middle, backward, sideways) 

9. Child can, using a picture game of ti.reo frames, arrange them in sequential order and tell 
what IS happening !n each picture. 

*10. (2) Childcan. when presented a £,I.i.j.:t; nursery rhyme, recite it accurately from memory. 

*1 1. (3) Child can name 8 of 1 0 pictures, {-bj^cts. people, animals, places) 

1 2. Child can verbalize first and last narr.e. 

13. Child can verbalize address. 

LEVEL IV CRITICAL THINKING SKII I .q 

T1. Child can give a conclusion to an ciy-')' piosonted story. 

T2. Child can retell important details aL" orally presented sentences. 

13. Child can fell the main idea of a story presented oraiiy. 

T4. Child can tell at least 3 similarities -••ut given objects. 

T5. Child can tell a! least 3 differencoc • Iwoen given objects, 

16. Child can sort objects into category. ..••!! given p jperfies. (For example: color, size, shape) 

1 7. Child can identify the one object H ' ; . • fJyrent from the other objects in the set (ball bat 
base-ball mitt, pencil) • \ ■ 
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T8. Child can tell why an object does not belong to a given set. 

T9. Child can recall at least a three-step sequence from an oral selectfon. r 

TIO. Child can verbalize a possible outcome of a described situation. 

T1 1. Child can orally idenfify cause and effect relationship from a picture. 

T12. Child can orally identify cause and effect relationship from a stoiy. 

T13. Child can orally identify cause and effect relationship from an event. 

LEVEL IV VISUAL M OTOR 

C 1. Child can draw a solid line from left t( 'ght when given visual direction. 

C2. Child can reproduce 4 of 6 geometric forms. 

3. Child car, outline four different shapes even when other parts are added, four of five times. 

4, • a. Child can cut oh a straight line for 12 Inches. 

b. Child ?an cut on a wavy line for 12 inches. 

T5, The child will be able to frame a word within a printed se itence. 



L£VELJV VISUM VFRqAI 

CI. Child can when presented with an object, name the object and give at least four 
characteristics of the object. Size, color, shape, use. 

piSurf " '^^^''"^^ ^" '^"''"^'^ sentences the feelings of the person represented in the 

STgi^en objecr"''"'' '° '^^P'' 
4. Child can identify and use opposite terms. 
C5. Child can use the word NOT in 3 complete sentences describing unlike objects or activities. 
6. Child can use singular and plural forms of verbs in the present and past tense in complete 

bP^S?n';'irh!;!w'^°r '2'"'^' ^^^^''^^ ^P^"^' ^^'a^onshlp between the items or 

behind or in back of. beside cr next to; between or in the middle of. (pencil is in front of the cup) 

T8. The child will be able to select the specific loiter named by the toacheV. 
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LEVELJM AUDITORY VFRp^l 

1 . Child can, upon hearing sounds made by an cb/eci. name and describe the objecf. 

2. Child can. after listening to a story, retell the story using complete sentences. 

3. Child can from memory, give first names of at liiasrseven members of his/her class. 

5. Child can. when given a word, respond with a synonyn, and/6r.a defintion. 

6. Child can. after hearing aVhythmic phrase or sentence, i^upply a corresponding pattern. 
^' /TJIfnS"' '"'"""^ ' °' "^''"^^ ^^'"P'e'^-sentences an individual's 
TB. The child can dictate a make-believe story in a minimum of three sentences. 
T9. The Child can dictate a story that describes a real event in a minimum of three sentences. 

T10. Child can identify the word or phrase omitted from a repeated sentence. 

^^^Et - V IMA GERY • MFMORY and .qp oi 'FMCIMri 

1. Child can. after being presented two-thirds of a story, supply the ending. 

2. Child can recall four details about clothing worn by another child. 
C3. Child can. when shown a picture for eight seconds, recall at least four details in the picture. 
T4. Child can. when shown a picture, identify 5 illogical elements. 

prope^serufnce''^^ T'.' °' 'T^J'^"^^^' '''''''' and/or words in 

puper sequence. (4,6.8,9 h.d.f.m dog. cat, horse, pig) 

C8. Child can pantomime, verbalize, and illustrate a sto.7 he/she has heard. 

T9. The child will be able to determine if a picture is real or make t)elieve. 

T10. The child will be able to determine if the orally read story is real or make believe. 

11. Child can. after viewing a room which has been rearranged, recall positions of objects in the 
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IJEVELYl SYMBOLIC RFAp iNIQ 

T1 . Child can identify and name at random the manuscript letter of the alphabet. 

12. Child can hear and name the letter forthe-beginning consonant sound of a word 

T3. Child can hear and write the letter of the beginning conso- • t sound of a word. 

T4. Child can hear, and name the letter for the final consonant sound of a word. 

T5. Child can hear, and write (he letter for tiie final consonant sound of a word. 

T6. The child will differentiate a line of printed words from a sentence. 
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K-1 TRANSITIONAL CUSSROOM 
Mathematics -Their Way 

MATH OR.IFnT|VF<? 

1. Child can, given various materials, explore and rifiscribe thern. 

2. Child can extend, complete, and describe pa'lsrns. 

3. Child can. given materials, sort, classify, and use words to label the sorted groups. 

4. Child can explore and describe the possible arrangements of a given number of objects. 
£. Child can demonstrate an understanding of conservation of number. 

6. Child can compare properties and describe likenesses and differences. 

Si:eSh%wS?nlJ^^^^^^^^ 

Child can compare length. rnasses. quanlities. durations. and volumes using non-standard 
..e!]M«norganizedala_ii^^^ .(Grapjiing). 



7. 



1 1 . Chilld can apply the oincept of number to patterns.. 

12. Child can develop-an understanding of the structure of the base ten number system. 
ADDITIONAI OBJFCTIVPc : 



1. Child can count by ordinals 1st though 10th. 

2. Child can recognize five basic shapes. 

3. Child can recognize numerals when out of sequence 1 through 10. 
Child can identify penny, nickel, dime, quarter, and their value. 
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Child can demonstrate understanding of '.ime and temperature relations. 
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Birthdaic:. 
Sex: 



Home Phone Number: 



Check Point for Kindergarten 
May, 1987 



Codc#; 



Name: 



School Attending Now; 



Home School: Of diff-rent than above) 



(Check One); 
Extended pay. 

(Check One); 
Race: 



Kdgn Enrichment 



Ars. ladlan or Asfan or 
^'h}U not of nispsDic 
,At«kan.\.tfvc_ P„c\t\c-Ishodtr~ 



Black, not of 
•Hlspanlr-Orlgln- 



.1/2 Day Kdgn_ 



Hispanic 
^(tallno) ' 



' Orlfilii 



Special Ed Services received Yes/Nf 
If yes. please specify 



Special Ed Referrals Yes/No 
if yes, please specify 



|Prc'5chool? YcsA'o If yes. where? 



Head Stan? Ycs/No. 



— 



> 



Code # 



CRITERIA K-1 TRANSITION ROOM 



mm 

1. Child can select a given numeral 1 through 10 
when spoken by ihe teacher. (100%) 

2. Child can count from 1 to 10. (100%) 

3- Child can identify the number of value of 
^ to 10 objects. (100%) 



4- 

5. 



i) 



Child can count by ordinals 1st through 5th. (100%) 

Child can name a given basic shape, mcludino- 
(4 cut of 5) 

circle 

rectangle 

triangle 

square 

eJiipse 

Child can name numerals 1 through 10 when out 
of sequence. ^100%) 

Child can solve a simple story problem given 
fnan:pu!a!?ves. (3 out of 3) 

J<afen ha d 2 large balls. Bob 



gave Karen 6 more balls.' How 
many balls dof^s Karen have now? 

Mary was playing with 5 blocks. Sho 
gave Jane 2. Mow many blocks does 
Mary have left? 

Larry has two pencils and Sharon gave 
him three more. How many poncils 
does Larry have now? 



6k Child can name two words that rhyme. 
i< out of 5 pairs with the word staled 
by Ihodeacher). 



-.nr»an» 
book, 



Sid. 
box, 
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p. Chfd can state firs: and last name 
„ . _ . .dddress. 

phone number 
age 

(3 out of 4) 

i br CHiId can oxpressldeas that are relevant to the 
topic being discussed. (100%) 

11. Child can tell a-^story in sequence. (100%) 

12. Child can listen attentively for at least 15 minutes 
(100%) 

13. Child can remain on task for 10 minutes. (100%) 

1 Child can (oHow a 3-step set of oral directions 
(100%) 

Go to the bookshelf. 
Ge! a book. 
Bring if Jo me. 

LEVEL m VISUAL 
C 4 a Child can identify like.nesses in 

pictures, letters, words and numerals. (80%) 

b. Child can identify differences in pictures, 
_ . _ — '©-Qfs,-.words«and..numeratls.-^(80%) ^ 

LEVEL III AUDITORY 

3. Child can indicate whether a given pair of words 
are the same or different. (8 out of 10) 
tub-tug .6. gum dumb 

2. lack.lack 7. bale-gde 

3. web-web ^ / a. sought-fought 
leg-led g. vow-thou 

5. chap.chap io. shako. shake 

l:E.V:ErLT[tfTlNTM^^ 

^ 12. Child can draw a lino t>d!v/oon the two 



pa'alleTlmes. (100%) 

15. ChWxan writr first name in manuscript 
using lower case. (100%) 




3. Child can identify each given color. 

^(b!ack; "brown; red. yeliow. blue, purple, 
green and orange) (lOOv©) 

1. ChlH can describe the activity in simple 

action picture with a sinnp.'e sentence. (100%) 

1 0. a. Child. can arrange a set of pictures i.i 

sequential order. (100%) 

b. Child can teff what is happening in 
each picture. (100%) 

11. (2) Child can recite a sentence accurately. ' 

•John arid Ma^7 went to school on a big yellow bus.' 

12. Child can rdcife a simple nursery rhyme 
accurately from memory. (100%) 

Irgygt. H VISUAL MOTOR , ' 

1- Chiid can d^aw a. solid liria from /eft to right 
when given :ii<^ direction. (100%) 

•Draw a straight line from left to right 
connecting the two dotsv* 

2. Child can reproduce a given geometric 
-form, .(4 .out of^ 6) 

a. Child can cut on a straight line. 
(12 inches) (100%) 

b. Child can cut on a wavy line 
(12 inches) (100%) 
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lEVEUy VISUAL VERBAL 

1. Child can give at least four charactefistics 
of a given object. (100%) 

. 2. Child can describe feelings of the person 
portrayed in a given picture. (100%) 

7. Child can describe" ihTspatia^^^ 

among several items behind or in back of- 
beside or next to; between or in the middle 
of criteria. (100%) 

IfVEUY AUDITORY MOTOR 

2. Child can follow oral directions which include 
Ihe Items forward/backward, on top. above 
below, inside, outside, left., right, berwoen-'or 
the middle. (100%) 

3- CWid can. when given oral directions move 
from left to fight by drawing solid, broken 
and/or dotted lines. (100%) 

lEVeuy AUDITORY VERBAL 

2. Child can retell an orally presented story using 
.- . . corinplele senterces. .(100%) 

Ask each child to draw themselves^ from head tc 
loe. (Page 16> 
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Uvctm ver bal Iflfl.^h , 

a. Child can arrange a set of pictures in sequential order. 

b. Child can tell what is happening in each picture. 
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i. Draw a straight line from left to right connecting the two dots. c 
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Ask (he children to draw a picture of themselves ^^Hh the frame. All children 
being tested could be asked to do at the same time. 
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Appendix K1-C 
K-1 Transition Currinilnm Ohffir.tivpg nocumftntatinn F^rm 
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I. Explore ^nd describe materials. 



Extend, complete, and describe patterns. 



3. Sort, classify, use words to label. 



A. Explore, describe arrangements of 
obiects. 



5. Child demonstrate conservation of number. 



6. Compare properties, describe likenesses 
and differences. 



7. Count through 10, recognize numerals 
match appropriate quantity. 



8. Compare length, volumes, non-standard 
units. 

9. Organize data in a systematic way to 
discover patterns. (Graphing) 



10. Extend concept of number by adding I 
subtracting. 



II. Apply the concept of number to patterns. 



12. npv<»Iop understanding of the structure 
of the base ten number system. 
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'2^ BaUncc benn ^forwards- 
backvardg-gidevayg) 



1. Maintain .balance left/ 
right foot (5 aee,) 



3. CalTop - 30 ' 12" path 
Hop forward 10' each foot 



5. Throw ball — hit target 
(3 of 4) 



"J5 Toaa 8" ball - catch 

first - bounce (2 of 3) 



6. Throw bean bag in 
vaatebasket 



Catch 8" ball 6' away 
(3 of 4) 



9. Kick moving ball 6" 



10. Fold 9 X 12 j)8per 1/2 
1/4 



djj Draw line betwe'i^n 2 lines 

3/8** apart 

12. Copy square, triai;gl'>^ X 



13. . Skip forward - 20' 



14. Child can writ<» first name 
j in manuscript using J 
I lower case. 1 1 
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TK Child can identify absurd 
elements in a picture* 



Child can draw picture 
showing their ending of 
orally presented storY> 



Child can draw picture 
showing aiain idea^f 
orally presented story. 



Match pictures to key 
pict ures. 

• f a — ■ 

^ Outline items regardless 
of size (6 of JO) 



Fonn figures from dot 
clues. 



Visually discrininate 
objects 



Piece together 12-1^ 
piece pu^zle^ 



Match leKer to correct 
letter froa 3 



Match numeral to correct i 

numeral from 3 [ 

Child can recognize first 
name in lower case | 
letters. | 



Child can recognize 
letter from a group of 
s ymbol s> 



o 
1 



108 



4 



c 
a. 



o 

< 

•1 

or 

Di 



M ac 
1 o 



O 
9 



!• Namet describe object froa 
sound. 



2. Retell story vith sentence 
from listenings 

3. Nsae seven kicsbers of class 



Hesr m storjthen identify 
four vorkers in conon. 



5. Given a vordt .respond 
vith syn> 



6. Hear rhythmic phrase and 
supply correct psttem> 



7. Heaispoen or atory^ 
describe feelings 



T8« Child can dictate isake- 
believe story 



79. Child can dictate story 
describes a real event. 



TIO. Child can identify the 
word or phrase onitted 
from a repeated sentence^ 
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[\cj Name object - give A 
•^""^ characteristics 



2c. Look at picture - describe 
feelings - end (se ntence). 



3c. Use descriptive terms 
sire, shape ^ 



soundj^ etc. 



4. Identify and use opposite 
tenas. . 



5c. Use vord NOT in sentences 



6. Use singular and plural 
foms of verbs. 



7c. Describe spatial relation- 
ship betveem items. 



t8. Child will be able to select 
specific letter n«ra«d by. 
the teacher. 
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Draw solid, dotted lines 
from visual direction. 



Reproduce geometric foms 
4 of 6 



Child can outline 4 different 
shapes even when other parts 
are added, 4 of 5 tiaes. 



Child can cut straight and 
wavy lines and distitjguish 
where to cut (approx. 12 x 2) 
Child will be able to f rane | 
a word within a printed 
sentence* 
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^J. Child giVe- concluiion to ' 
orally prea«nccd atorr 


















U. Child retell detaila about" 
— OMlljrjreaented aentenr*.. 


















IJ. Child tell ..in idea of 
■tory preaented orallv. 
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T«. Child tell 3 aimilaritiea " 
about objects. 


















T5. Child tell i difference! 
oetween «;iven obfecta. 


















16. ttind aort objecta into 
• categorica vith given 
propertiet* 
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T7. Child identify one article " 
different froa the let. 
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T8. Child tell why article not" 
belonit in set. 


















T9. Child recall 3 ttep iequencc 
froa oral celaetion. 


















TIO. Child Terbalice outaone 
ojf deveribed tituttion. 


















III. Child can orally identify 
cauae /affect reUtionahlp 
xrom a picture* 


















rJ2. Child c«n orally identify 
c«o»€/cffcc relationthlp 
















1 


n3. Child can orally identity 
caute/effeet relationship 
fron i:ii*ev9nt. 
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Supply ending to m itory. 



Reciill four (4) details 
clothing vorn 



Recall four (4> details 
in 'a picture^ 



T4. Child can identify 

illogical eleaent in 
a picture^ 



Repeal four U) letters* 
nunbers, vorda in sequence > 



Child can repeat by vriting 
series of 4 letters* numberi 
words in sequence > 



(No objective) 



Pantonine t verbalise, or 
illustrate story heardi 



Child determine if picture 
real or nake believe. 



TIO. Child determine if story 
read orally is real or 
sake believe. 



Recall position of objects. 



T12. Follow five (5) directions 
in sequence. 



TI3. Recall in correct sequence 
a 4*-step activity. 



Ti4. Child can supply words 
make sense r sentence 



o in 
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TIS. Child will identify a 
printed word for given 
spoken word. 



118 





1^ 


1 

i • 

j 




• 


1 


1 


• 








• 


1 










• 


• 


K-l TRANSITIONAL : 
Level VI 

• 

SynboHc Reading VI 
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! Tl. Child can identify and 

na»e at random lettera of 
1 alphabet. 
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1 T2. Child can hear and.na»e 
the letter for the 
beitKinft con. aound« 








































T3. Child can hear and vrite 
the letter for beginning 
con* aound. 
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T4. Child can hear and na»e 
the\etter" for final 
con* aound. 








































T5. Child can hear and write 
the nine of the letter 
of final con. found. 
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T6. Child will differentiate 
a line of printed worda 
fro« a aentence. 
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Appendix Kl-D 
Chapter 1 Flementarv Frir^c gtional Plan ,? i immarv Rf^ pftl 
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CHAPTER 1 ELEMENTARY EDUCATIONAL PLAN SUMMARY REPORT 



SCHOOL 



TEACHER 



Send to Wilson office by May 22, 1987« 
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READING. 
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Appendix K1-E 
K-1 Transftfon Parent Cnn tact Summaiy RhPftf 
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K-1 Transition Program 
Parent Contact Summary 
1987-88 



Name 



Center 



rSfrTn?/''! "^^'^ newsletters, conferences, open houses, etc.) and the 

number of parents or guardians contacted during the 1987-88 academic year in the spaces below. 



Date 



Type of Contact 



Number of Parents 
Contacted 



FRir 
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Appendix K1-F 
K-1 Transition Parent Fnll^w | ip Q,.oc|.Annp,!ro 
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K-1 Center 



DES MOINES PUBLIC SCHOOLS 
K-1 TRANSiT.ON PROGRAM 
PARENT FOLLOW UP QUESTIONNAIRE 

Sfsff fn^o!!!^ directly Involved with the K-1 Transiton Program, the Des Moines 

S^l^! , ^"^^w? ""^^^ P^^^^f"- P'ease answer the followlno queSs as 

fnd TSl'n??'"^" f '''''' questionnaire to the Department of E aluaTn K 

WonS ^w- "^'^^^^ '5 "0 Information Included on the quest onnaS to ' 

Identify you d.reclly and your answers will be confidential. quesiionnaire to 

1. What changes have you seen In your child since he/she began the K-1 Program? 



2. What are the strengths of the K-1 Program? 



3. What are the weaknesses of the K-1 Program? 



4. What changes would you like to see In the K-1 Program? 



1987-88 



Report of Evaluation: 
READINGAA/RITING LAB PROGRAM 
1987-88 



Department of Evaluation, Research, and Testing 
Des Moines Independent Community School District 
1800 Grand Avenue 
Des Moines. Iowa 50307 




John Tompkins 
Program Evaluator 




Director of Evaluation. Research, and Testing 
October 20. 1988 
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INTRODUCTION 




I 


Program Descrrption 






flvlosoDhv and Goals 




i 


The underlying philosophy behind development of the reading/wriili 


'G J-tb program is that reading 




and writing are integrated processes based on language dev^elopment. 


Students are therefore given 




opportunities to participate in an integrated language process involvinr; 


*^:«ding, listening, writing and 


■ 


speaking. These language processes are active and are to be whole, 


^•Cilonal and meaningful. 




Higher order thinking skills are to be developed within these procesfM^r. 


"«:d students are encouraged to 




learn to write in two ways: (1) by writing; and (2) by reading good writing. 






Six goals were identified for the reading,^vriting program during tho - 


^37-88 school year. They 




were: 




(1) Lab students will show improvement in reading/writing achievement; 


- 


(2) Administrative statf for tho Des Woines Plan will participate in thr 


dovelopment of 


* 


criterion referenced tests to be implemented as a measure of gr 


y.'.th for students in 




the program; 






(3) Comprehension, word an;^lysis and vocabulary strategies will Lo 


*/v.^luated and 




revised as needed by staff; 






(4) Jnservice sessions wiSi i)o designed to onhance'the program i\;i'; 


i»uvidofor 




professional and pers^^-ral grovirth. Clc*:>sroom teachers will be- ^J, 


A;:ithe opportunity 




to participate in inservfce sessions; 






(5) Reading and wriling v;:;i be laught using an integrated appioncl.. 


and 


> 


(6) Computer-assisted instruction will be implcmenled to support {he 


1. b program. 




Inr iructional Model 
The Chapter 1 program is the instruclional model used in the readincj/. 


'•^linalabs. This model 
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includes small group instruction, diagnosis, mastery learning approaches, individual educational plans, 
highly motivational supplemental curriculum (including manipulatives). coordination with classroom 
teachers and district curriculum supervisors, parental involvement, Inservice and support, computerized 
recordkeeping and effective teaching strategies. 

Identificati on Pror.firinrPs 
Identification of students in need of additional Instruction is assurred through checkpoints. The 
tests are a check to see at what point students are mastering certain subjects for their appropriate grade 
level. The tests will be given in grades 1 . 3. 5. 8 and 1 1 . There were 41 .3 lull time equivalent teaching 
positions In grades 1-5. 12.5 positions In grades 6-8; and 4.5 positions in grades 9-12. At the end of 
the school year. 2.106 students were served in the readingMriling labs at the elementary level. 619 
students were served at the middle school level (grades 6-8) and 152 students were se.ved at the 
senior high level (grades 9-12). 

Budpet and Fxp enditure^ 



The budgetary information for the Reading/Writing Lab Program for the 1987-88 school year was 
provided by The Des Moines Plan Supervisor in October. 1988. Figure RW- 1 below indicates the 
funds allocated and expended in the ReadingWriling Lab Program for various line items included in 
the budget. The total appropriation for the Reading/Writing Lab Program was $2,355,884.00. This 
was provided through the following sources: Educational Improvement Grant. Dropout Prever.i.on. 
Budget Review, Chapteril. Chapter I and the district's general fund. The program abstract indicates 
the allocations from each funding source to the overall Des Moines Plan. Due to the method in which 
budgetary records are maintained it would have been an extremely time consuming task to determine 
the allocation !o |his prpqrflmonly . from each separate funding source. Therefore, only the total 
amount allocated is reported for each line item. 
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Budget and Expenditures ReadingA/Vriting Lab Program * ' 
1987-88 




'r 


Category 


Amount Allocated Expenditure 






Salaries 


$1,696,893 $1,405,473 






Fixed Charges 


222.756 222.756 






Administration 


25.968 11,980 






Indirect Costs 


35.562 35,562 


; 




Parent Component 


1.875 . 1,786 






Evaluation 


16.365 16.365 






Software/Materials/Supplies 


110.950 78.948 






Inservice 
Telephone 


. 54.920 26.786 
1200 laftR 




< 


Mileage 


2250 1763 






LayReaders 


10.000 0 






Computers 


165605 251873 






Classroom Reconfiguration 


11500 11,485 






TOTAL 


$2,355,844 $2,065,665 




: 


As reported by Des Moines Plan Supervisor, October. 1988. 






During the 1987-88 school year. $2,065,665.00 was expended to operate the Reading/Writing 




\ 


Lab Program. This represents 87.7 percent of the amount allocated. The majority of the unspent 




I 


funds are eligible for carryover to be used during 1988-89. It should be noted that due to the 






complexity of the funding mechanism and the system used to maintain budget documents, laborious 




L - 


procedures were necessary in order to generate the budget information in the above format. 




;■' O 
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PROCESS AND PERFORMANCE OBJECTIVES ' 
Elementary Reading/Writing Lab Program 
Objective II A1 

During the instructional year the coordinator will organize and maintain an accountability file and 
provide copies of the data to support the evaluation of all objectives as documented by accountability 
files maintained in the project office and the Department of Evaluation; Research; and Testing: 

Results 

Duplicate accountability files were maintained in the Des Moines Plan Office and the Department of 
Evaluation. Research and Testing during the 1987-88 school year. Periodic checks were conducted 
during the school year to assure that data to evaluate program objectives were being collected. The 
data were forwarded to" the Department of Evaluation, Research and Testing at the end of the 1987-88 
school year. 

Objective II B2 

By November 27, 1987. the elementary principals will have monitored by classroom visits, the 
activities of all lab teachers and classroom teachers to assure that lab students are receiving direct 
reading instruction from the classroom teachers as well as from lab staff as documented by reports of 
supervision of the lab program, submitted to the Executive Director of Elementary Education. 
Des hAoines Public School, or to the Superintendent of Schools. Des Moines Catholic Diocese, by 
December 4, 1987. 

Evaluation Method 

The Principal's Report of Des Moines Plan Supervision submitted by each building principal was 
examined to determine evidence that lab students were receiving classroom as well as lab instruction. 

P eS Lilt S - 

The Principal's Report of Des Moines Plan Supervision is an annual report submitted by elementary 
principals in December to document that.Des Moines Plan lab students are receiving instruction from 
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Classroom teachers and that joint planning Is occurring between classroom and Des MoinescPlan 
teachers. A copy of this tomi appears in Appendix fVW. M-A. Documentation is gathered by principals 
observing a regular classroom that includes Des Moines Plan students and by observing planning 
sessions between Des Moines Plan and classroom teachers. The report serves the same puTX>se as 
and was an outgrowth of the Principal's Report of Chapter I Supervision that had been completed by 
elementary principals of Chapter I buildings for a number of years. 

Several discrepancies were noted concerning this report during the 1987-88 school year. They 
were as follows: 

(1) No report was submitted by the principals of five buildings. This occurred despite the fact that 
the Des Moines Plan Supervisor sent a letter to all etementao^ principals dated March 3. 1 988 to remind 
those that had not completed the report at that time to do so; 

(2) At four buildings, the purpose of the observation was apparently unclear as the principals at 
those-sites'obsep;^e-dtabWs-es7athirth-an?eg^ 

(3) Observations were made after the specified date in eleven cases-in two cases, not until March 
and April of 1988. 

Given that some principals had not been required to submit this torn previously. !.e. principals of 
buildings r>ot served by Chapter I. It is not surprising that the record of submission and accuracy for this 
..documem.was.not.as good.as.in previous,years. Steps-that might be taken to improve this situation 
would Include more detailed instructionsiconcerning completion of the form and increased efforts to 
fotiow-up in situations where-the form is submitted inaccurately or not at all. In addition, a decision needs 
to be made as to the requirement for nonpublic school principals to be involved in this activity. It would 
seem difficult for these individuals to observe particularly the joint planning efforts between Des Moines 
Plan and classroom teachers when the Des Moines Plan teachers no longer serve student3 from the 
nonpublic buildings at the non-public school site. 

Obiectivfi III A1 

// the end of the instructional year, lab students, grades 1-5 who have been enrolled in the program 
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for at least 80 days will demonstrate an increase in the mean percentile rank from pre to post test on the 
vocabulary and comprehension subtests of the Iowa Tests of Basic Skills (ITBS) as documented by 
scores from fall and spring testing, submitted to the program evaluator at the end of the instmctional 
year, 

Obieclive III Ag 

At the end of the instructional year, lab students, grades 2-5. who have been enrolled in the 
-program for at least 80 days will demonstrate a proficiency on the vocabulary and reading 
comprehension subtests of the ITBS. such that the average gain in normal curve equivalents (NCEs) will 
be at least 5.0 as documented by scores from fall and spring testing submitted to the program evaluator 
at the end of the instmctional year. 

At the end of the instructional year, lab students in grades 1-3. who have been enrolled in the 
_£rogram for a t least 80 days will demonstrate a Droficierv^ynnjh^vnn^N^^^ 



comprehension subtests of the ITBS. such that the average gain in NCEs will be at least 7.0 as 

documented by scores from fall and spring testing, submittedto the program evaluator at the end of the 
instructional year. 

Objective III A4 

At the end of the instructional year, lab students, grades 4-5. who have been enrolled in the 
program for at least 80 days v/ill demonstrate a proficiency on the vocsbulary and reading 
comprehension subtests of the ITBS such that the average gain will be at least 3, 0 as documented by 
scores from fall and spring testing, submitted to the program evaluator at the end of tlw instmctional 
year. 

Cvalualion mftthp f j 

Students injhe Des Moines Plan Reading/Writing Lab Program at the elementary level complete 
the vocabulary and reading comprehension subtests of the Iowa Tests of Basic Skills in October and 
/^pril of each year. Raw scores for those students who completed both a pre and post test are 
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converted ultimately to percentile ranks and normal curve equivalents. The objectives in the proposal 
specify various criteria for the NCE gain between pre and post testing by grade level. 

Results 

Tables fVW 1 and R/W 2 present data that are necessary to evaluate objectives III A1 to III A4. 
Narrative pertaining to these objecJives follows the tables. 

Table R/W-1. Vocabulary and Reading Comprehension Iowa Test of Basic Skills Grades 1-5 

(Percentile.Rank). 

■ Vocabulary • Readinn r:nmp rphpp.^.^q 



Qrasis. 


U 


Em 


EflSl 




u 


Pre 


Post . 


^2310 


1 


384 


34. 


32 


•2 


384 


<c 


31 


+21 


2 


388 


20 


28 


+8 


388 


17 


28 


+11 


3 


209 


21 


27 


+6 


20i' 


17 


28 


+11 


4 


183 


24 


30 


+6 


183 


25 


28 


+3 


5 


64 


22 


24 


+2 


64 


20 


26 


+6 
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Table RAV-2. Vocabulary and Reading Comprehension Iowa Test of Basic Skills Grades 1-5 

(Normal Curve Equivalents) 







Vocabufary 






figadioa 


ComDrehenRipT 


Gradg 






£&S1 




H 


££fi 


Post 




1 


384 


41.2 


40.5 


-0.7 


384 




39.4 


+16.8 


2 


388 


32.3 


37.6 


+5.3 


388 


29.5 


37.7 


+8.2 


3 


209 


33.1 


37.3 


+4.2 


209 


29.9 


37.9 


+8.0 


4 


183 


35.1 


38.7 


+3.6 


183 


35.6 


37.8 


+2.2 


5 


64 


33.2 


35.2 


+1.8 


64 


32.6 


36.5 


+3.9 


2-5 


844 


33.2 


37.6 


+4.4 


844 


31.2 


37.7 


+6.5 


1-3 


981 


36.0 


38.7 


+2.7 


981 


26.9 


38.4 


+11.5 


4-5 


247 


34.7 


37.8 


+3.1 


247 


34.8 


37.5 


+2.7 



students demonstrated an Increase In the percentile rank at all grade levels except grade 1 where 
the percentile rank declined 2 units from the pretest to the post lest. It is interesting to note that the 
largest increase in percentile rank occurred in grade 1. the same grade at which the largest decline 
occurred in vocabulary. 

The criterion In Q^imMM states that sludentc in grades 2-5 will achieve an average gain of 5.0 
NCE units on the'vocabulary and reading comprehension subtests of the Iowa Tests of Basic Skills. The 
Normal Curve Equivalent (NCE) scale is similar to the percentile scale except that it is an equal interval 
scale meaning that the distances between units are the same. This allows for the process of averaging 
I of scores which Is not feasible with percentile rank scale as the distance between units is not equal 
throughoul the scale. A weighted average gain was computed due to the difference In the number of 
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Students a: |he various grade levels, tn vocabulary, the weighted average NCE gain for grades 2-5 was 
4.4 comparevi to a criterion of 5.0. in reading comprehension, a gain of 6.5 NCE units surpassed the 
established criterion. 

The crHerion in Objective III A3 for the weighted average gain for grades 1-3 was 7.0 NCE units for 
vocabulary.and reading comprehension. Students who completed pre and post tests at these levels 
showed a weighted average NCE gain of 2.7 in vocabulary and 1 1 .5 in reading comprehension. These 
results indicate a considerable discrepancy in the amount of gain demonstrated by students on the 
vocabulary and reading comprehension subtests at these primary grade levels. This is a continuation of 
the same pattern that has occurred at the primary level for a period of several years and may res^A from a 

differential emphasis in the two areas or may be a function of different rates of learning in the two areas 

that are typical of students at this level. It should be noted that gains for the two subtests tend to 

t)ecome nwre similar as Ihe age of the student Increases. 

Thejalfirioa for the weighted kver.^ge gain expressed in Objective III A4 for grades 4-5 was 3.0 

NCE units for vocabulary and reading comprehension. The weighted average gain was 3.1 In 

vocabulary and 2.7 in reading comprehension. 



Q bieclrve III A ?? " 
At the end of the instmctional year, lab students who have been enrolled in the progrp-u for at least 
80 days wilf demonstrate an increase in their holistic siting scores as documeted by writing scores from 
September and May submitted to the program evaluator. 

ncsuii<; 

Information pertaining to pre/post holistic writing scores for Writing to Read students may be found 
in a separate document pertaining to the Writing to Read Program. 

Obi GCtivo lil Afi 

At the end of the instmctional year, lab students who have been enrolled in the program for at least 
80 days will have a working knowledge of the writing procass as documented by a minimum often 
writing assignments for each student on file with the lab teachers. 
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Evaluation rpft{ho;J r 
During the 1987-88 school year. lab prograrti students were given instruction in the process of 
writing. To demonstrate proficiency, students were to complete a minimum of ten writing assignments 
which were evaluated by the lab teacher-and then placed on file for future-reference. 

Documentation indicating the number of writing assignments was received from 30 of the 41 
elementary buildings. The lack of an appropriate reporting form for this objective was the 
probable cause fo; eleven buildings not submitting the proper documentation concerning writing 
assignments. Of the 1 .375 students reported to be enrolled for 80 days or more. 777 (56.5 percent) 
completed at least ten writing assignments. Objective III A6 stated that a minimum of ten writing 
assignments were to be completed by each student. With no other criterion suggested..this.objective- 
was not achieved. 

Objective III A7 

At the end of January 1988, lab students who participated in the Writing to Read Program during the 
secSnd semester of their kindergarten year (19S6-87) and during the first semester of their first grade 
year (1987-88) will have writing assessment scores that are, on the average, greater than scores for a 
■control group as documented by pretest scores (January 1987) and post test scores (January 1988) on 
file in the Writing to Read office. 

Obieclive III AR 

At the end of January 1988, lab students who participated in the Writing to Read Program during 
the second semester of their first grade year (1986-87) and during the first semester of their second 
grade year (1987-88) will have writing assessment scores that are, on the average greater than scores 
for a control group as documented by pretest scores (January 1987) and post test scores (January 
1988) on file in the Writing to Read Office. 

R es ul ts 

Information pertaining to writing assessment scores for Writing to Read students may be found in a 
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separate document. r 

Obiectivft III A,cf 

At the end of the instruction year. 65 percent of the kindergarten lab students in the Writing to Read 
Program will be at or above Waupun (Strategies in Earty Childhood) Level 4 as documented by Waupun 
information on file in the Writing to Read Office. 

Evaluation n]^\\^nrt 

Kindergarten students in the district follow an early childhood sequence of objectives known as 
Strategies in Early Childhood Education that were developed in Waupun. Wisconsin. A student is«aid 
to have completed a particular lever if mastery of the learning objectives associated with that level has 
occurred. Writing to Read teachers kept records on students indicating the level completed by the end 
of the year In the Strategies in Early Childhood program^ 

Pesults 

Table WW 3 indicates the percent of kindergarten Writing to Read students who are also served by 
the Des MolnesPlan that achieved level 4 or above as determined by the Strategies in Early 
Childhood (Waupun) objectives. 

Table RAV-3. Strategies in Early Childhood (Waupun) Kindergarten Students in 
Writing to Read and D.M. Plan 1987-88 ' 



School Number of Number of 

Students Students >Level 4 Percent 



Edmunds 17 07 

Lorigfellow ' 20 16 

McKinley 18 13 

Moulton No kindergarten students in Writing to Read Program. 

TOTAL 55 *" ■ 36 



41.1 
80.0 
72.2 



65.5 
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AS indicated by Table RW-S. 65.5 percent of the kindergarten students who participated in both 
the Writing to Read Program and The Des Moines Plan achieved level 4 or above on the Waupun 
Strategies in Early Childhood Education sequence of ob|ectjves. It should be noted that two of the 
three Writing to ReacJcenters enrolling kindergarten students surpassed the indicated criterion of 65 
percent. Ai {he othercenter. 41.1. percent of the students had mastered level 4 at the end of the year. 

Obiectivg lll A1Q 

At the end of the instructional year, 80 percent of the nonlab kindergarten students in the Writing to 
Read Program will be at or above Waupun Levels as documented by Waupun information on file in the 
Writing to Read Office. 

Evaluation nftthpff 

„ Same.affor.pbjMive ll.l:A9.-^^ - - ~ 



Result!^ 

Table RM4 indicated the percent of kindergarten Writing to Read students who are nCserved by 
the Des Moines Plan that achieved level 5 or above as determined by the Strategies in Early Childhood 
objectives. 

Table RAV-4. Strategies in Early Childhood (Waupun) Kindergarten Students in 

Writing to Read Only 1987-88 

School Number of 



Number of Students 
Students ^Level 5 



'ercent 



Edmunds 54 
Longfellow * -j 7 



30 
17 

Mckinley 22 1 0 

Moulton No kindergarten students in Writing to Read Program. 



55.6 

100.0 

45.5 



TOTAL 



93 



57 



61.3 



in 



in 
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Table.RAA/.4 indicates that 61.3 percent of the kindergarten students who received insfruction ii 
the Writing to Read lab. but who were not served in the Des Moines Plan attained level 5 In the 
Strategies In Early Childhood sequence. At one center. Longfellow. H was reported that all students I 
the Writing to Read Program achieved level S. Lesser numbers of students achieving the specified 
criteria at the other two centers caused the total number of students reaching this level to fall below the 
80 percent criterion. 

•Obiedrve III A11 

During the instructional year. 80 percent of the first grade students in the Writing to Read Program 
witlcpmpfete ten instructional cycles on the computer and in the workpurnals as documented by class 
profile sheets; submitted to the Writing to Read Office at the end of each semester. 

. _ ^ , • -SitahiaiionMsihsi: — 

Students in the Writing to ReadProgram may complete up !o ten instructional cycles in the Writing 
to Read Program. Lab teachers recorded the date of completion of each cycle on a class profile sheet. 

BesuHs 

-able RW-5 indicates the number of students at each WTR center that completed ten instructional 



cycles. 



Table RAV-5. Computer Instructional Cycles Writing to Read Program 
First Grade Students 1987-88 



School Number of 



Number Completing 
Students Ten Cycles 



6 



Edmunds 25 
Longfellow 14 ^ 

0 



McKinley 1 2 

l&HiSCr- .i 29 

TOTAL 80 



Percent 

24.0 

7.1 

0.0 

M 

8.8 
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This objeclive was not achieved. Of the eighty first grade students enrolled in the Writing to Read 
Program, only 7 or 8.8 percent completed ten instructional cycles. At two centers. McKinley and 
Moulton. no students completed all ten cycles. 

Objective IV 

By September 18. 1987. lab teachers will have selected students, grades 1-5 as documented by a 
list of students (by grade level) who were selected for instruction and the rank order checklist, submitted 
to the program coordinator with September accountability data. 

Evaluation Mf>\tyQ^ 

The 00^- Moines Plan was not officially implemented until January of 1988 following the initial 
ad.Tiin?stration of checkpoints. However, asMM was.hired.at the-beginning of-1987-88; students were 
selected for instruction based on criteria established for identification by the Chapter I Programs. These 
•criteria were established with the idea of being able to rank order students starling with those "in 
greatest need" of assistance. Students were then selected in rank order until classes were filled. 
Teachers completed a Des Moines Plan Pupil Enrollment Form tor each student as he/she was e-alected 
tor the.program. The information on this torm was entered on-line to what had been referred to as the 
-Chapter I database." now expanded to accept student records from all buildings. 

An initial set of class lists were produced from the database on November 17. 1987. Table RAV-6 
Shows the number of students that were originally identiJied at each center by grade level tor the 
reading/writing labs. 
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Table RAV-6. Number ol Students Served Des Moines Plan ReadingWriiing Labs 

(Elementaiy) 

a A 5 



Builffirifl £ 

Adams 5 

All Saints 7 2 

Brooks 15 20 

Cattell 15 

Douglas 6 7 

^Hdmu/Jds 25 24 



Wilfard 22 1 0 

Windsor 7 1 7 



TOTAL 533 564 
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10 11 5 44 

3 1 2 15 
0 0 0 45 

4 7 3 44 
0 0 0 13 

11 16 5 81 



Findley 10 10 ii ^ 

Carton ]l ^ t V II 

Granger 22 23 17* e n 

Greenwood 7 I8 <» ^ 2 ^® 

Hanawatt 7 8ft j ! 

Hillis 15 10 1^ f ! 30 

Howe 10 Is I I J !i 

^ Hubbell 4 1100° 

(• f?!'^'' 30 "20 10 ?3 S 7! 

V Jefferson 6 a 1 '"^ " 7o 



Longfellow 9 24 15 ?o ? |2 

Lovejoy 4 4 3 n « 

Lucas 24 18 25 ?o ? 

Madison 17 ,1 ?o ° 3 

Mann 13 3 2 9 n S 

McKee n g 2 ? ? 

McKinley 15 n f ^ 26- 

Mitchell 5 i o. 1° • 5 ^9 

Monroe 0 0 15 5 2 

Moore 6 n 9^ ? 25 

MoultOR 33 33 ,c If ° 

Oak Pa* ?3' ' ? ? f ;2 113 

ParkAve. 7 13 7 a 1 

Perkins 0 ' J' ^ 20 ? It 

Phillips -12 ^2 I 7 J ^ ''^ 

-p^Hiu '0 2 « ; ^ 

Rfce 2? 23 S V ^ ^2 

'3 3? 7 3 5° 

Watrous 3 7 J ! 2 42 



3 0 14 

5 0 0 37 



Woodlawn 10 15 2 ? 2 ^« 

VVright 15 8 4 2 36 



8 1 36 

327 273 105 1802 
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AS can be seen from Table RAV-6. 1 .802 students were initially idonlified for participation in 
Des Moines Plan ReadirigAVriling Lab classes at the elementary level. A full time teacher according to 
the program proposal could serve between 45 and 55 students. 

Efforts are currently being made to develop a a revised Des Moines Plan enrollment document that 
will reduce the amount of data entry that currently is performed by Des Moines Plan clerical staff. This 
slep.shou!d aflow for generation of initial class lisls in a much more timely fashion. This objective was 
•achieved as the actual process of student selection was completed by the specified date. 

Obi ective IV 

During the instructional year, lab teachers will develop and maintain an IBP for each student 
■ --■receimglal} instfuc1idri as documented by lEPs on file with the m tenchers. 
p Eyaluation Mftihorj 

: Des Moines Plan consultants examined Individual Educational Plans durinc visits to program sites. 

At the end of the first semester, the consultant initialed a form entitled "Dos Moines Plan Educational 
Plan Summary Sheet' v hich indicated that each lEP had been examined and was properly written. 

Results 

Individual Educational Plans were developed and maintained for each Des Moines Plan student. 
The educational plan included a listing of objectives to be introduced to each student and various 
teaching strategies that will bo employed. As indicated above. Dos MoTncs Plan consultants monitored 
the existence and completeness of those documents. 

During the instmctional year, lab teachers will instruct 45-55 students for 25-30 minutes daily as 
documented by lab scliedules. submitted to the program coordinator by Snniomber 13, 1937. snd 
resubmitted each time a schedule change is made. 

Lab teaching schedules were submiitod by all Des Moines Plan fcochcrs as ct.isscs began in mid 
^eptember. Revisions wore, submitted as necessary during the school year. 
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Results ' 
Lab leaching schedules indicated the lab teaching limes and number of students sen/ed In each 
group. Other information appearing on the schedule included the time that direct instruction is provided 
by the classroom teacher in the same subject area and the time that the lab teacher and classroom 
teacher engage in planning sessions. The schedules indicated that lab classes met from 25-30 minutes 
per session and that a full time teacher served from 45-55 students as specified In the objective. Group 
sizes ranged from 1 to 8. I^uch of the infomiation on the schedules is verified at least once during the 
year when the building principal conducts the observations necessary to complete the Principal's 
Report of Des Moines Plan Supervision. (See Objective I! 81 tor a discussion of this document). 

Objective IV R4 



■ - ' • WtfieenclSf the first semesler. Tab teachers will have peisorjal conferences with the 
parents/guardians of at least 80% of the total number of lab students, grades 1-5. whohavebeen 
enrolled in the program for at least 20 days. These conferences wilt be conducted at the homes of. or at 
places selected by. the parents/guardians as documented by attendance/parent contact reports, 
submitted with January accountability data to the program coordinator, program evaluator and building 
■principals. 

Obiectivfi IV 

By the end of the second semester, lab teachers will have had personal conferences with the 
parents/guardians of at hast 80 percent of the total number of lab students, grades 1-5. who have been 
enrolled in the program for at least 20 days during the second semester. These conferences will be 
conducted at the homes of the parents/guardians, at school or by telephone as documented by 
attendance/parent contact reports submitted with May accountability data to the program 
coordinator, program evaluator and building principals. 

Evalualinn MffjhQ^^ 

Oes Moines Plan teachers completed a preslugged "Attendance and Parerit Contact Form" at the 
end of each semester. The form indicates the days possible for attendance during the semester, the 
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days attended.and the number of home visits and personal contacts made by the teacher to' the parents 
of each student. The forms are scanned by Mid Iowa Compi-'er Center, the information becomes a part 
of the database and summary reports are produced which allow for evaluation of these objectives. 

Besulis 

Table R/W-7 provides the data necessary to evaluate objectives IV B4 and IV B5. both of which 
concern contacts with parents of students in Des Moines Plan labs. 

Table R/W-7. Contacts with Parents Des Moines Plan ReadingWriling Lab Students 

Grades 1-5 1987-88 



First Semester Second Semester 

-Grades. r— :Nnr-r- :™Percent^--~~T6ial- T^nr Total 

Contacted Contacted Contacts Contacted Contacted Contacts 

9 



During the first semester, objective IV B4 specifies that lab teachers will have personal contact with 
the parents of 80 percent of the students enrolled for a period of 20 days or mo^ Personal contact 
implies a face to face contact between the parent and teacher through a home visit by the teacher or a 
visit 10 school by the parent. Telephone calls made or letters sent to the home do not count as personal 
contacts during the fall semester. During the first semester, parents of 82.8 percent cf the 
Reading/Writing Lab students were contacted, thereby surpassing the established criterion. Objective 
IV B5 also specifies that parents of 80 percent of the students enrolled 20 days or more during the 
second semester will be contacted personally, but allows telephone calls made to the home to be 
counted as parent contacts. During the second semester, according to Table R/W 7, par-nis of 83.4 
percent of the Reading/Writing Lab students were contacted also surpassing the criterion of 80 
percent. The table shows a total of 4,838 contacts (2,423+2.475) made during the year to parents of 
lab students. This would seem to represent a continuation of the long existing trend in the dislricfs 
Chapter I programs of,mainlaining a high level of contact with parents of lab students. Objectives IV 84 
and IV B5were 
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achieved. ^ 

Objective IV p(} 

By October 2. 1987. lab teachers at each building will have submitted the rjame of a parent to be a 
representative on the District Pare^nt Advisory Council as documented by parent names, submitted to 
Ihe Des Moines Plan Supervisor. 

Results 

A list of representatives to the Chapter l/Des Moines Plan District Parent Advisory Council was 
received by the Department ol Evaluation. Research and.Testing on March 1 0. 1988. The list itself was 
not dated, making it impossible to determine when It was developed. The list contained names, 
addresses and telephone numbers of 59 building representatives and 3 community representatives. It 
-should:be-note-d-4hat.i»hiipom§:i)uiIdinp^ 
elen.enta.y buHdings were not represented. In as much as the intent of this process objective was to 
have representation on the council from each attendance center involved with The Des Moines Plan, 
this objective was not achieved. 

Qbt ective IV B7 

During the instructional year. Writing to Read teachers will schedule and instruct students in the 
Writing to Read Center for one hour daily as documented by classroom and lab teachers' daily 
schedules, submitted to the Writing to Read Coordinator. 

Evaliiatlnr. hA?\\]Q^ 
Schedule forms were submitted by each Writing to Read lab teacher. 

Result*; 

Schedules submitted by teachers providing instruction to students in the Writing to Read labs 
indicated thai such instruction was provided for a period of ono hcur on a daily basis. This compares to 
the one half hour of daily instruction that is the norm for the regular Des Moines Plan lab class session. 

OblGC livO IV RB 

At the beginning of the instructional year. Writing to Road teachers will provide orientation for 
^ 146 
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■studenis one week prior to full-time attendance in the Writing to Read Centers as documeilted by 
teacher lesson plans submitted to the Writing to Read Coordinator at the end of the first n^nth of the 
instructional year. 

Evaluation Methofj 

Writing to Read teachers submitted copies of lesson plans for the period during which an orientation 
to the program for students was held. 

BfeSUUs 

Lesson plans submitted by Writing to Read teachers indicated the occurence of orientation 
sessions at all Writing to Read Centers. According to the lesson plans, the sessions involved an 
explanation of the rules for the lab. sharing materials, care of equipment and hands on practice with the 

r— cofnpyte.r:equjpmemr-Thjsobjectjve-w^ — - . 

Obiedivfi \\l RQ 

During the instmaional year. Writing to Read teachers will maintain a file of samples of students' 
writing as documented by dated weekly samples of each students' writing on file with the Writing to 
Read teachers. 

Resiilifi 

Weekly samples of students* writing were maintained in each Writing to Read Center. The 
Des Moines Plan consultant working with the Writing to Read Program monitored the existence of the 
writing samples regularly during visits to each center. 

ObiGCtivG IVR10 

During the instmctional year, the Writing to Read assistant will monitor children at the computer, 
work Journal, and listening stations as documented by teacher lesson plans on file with the Writing to 
■Road teachers. 

ficsiills 

0 The Des Moines Plan consultant for Reading/Writing that worked specifically with the Writing to 
Read Program ic-pdned that individuals were not specifically hired to fill the position of Writing to Read 
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assistant. Instead, a building associate or other individual such as a volunteer was often used to assist 
ieachers in the Writing to Read lab. While It appears these individuals were useful in assisting the WTR 
teachers with a variety of lab activities, this objective should be modilied K persons will not be specifically 
designated to occupy the position of Writing To Read assistant. 

Obiedivft VI R-] 

N^^'tf^e end of Iheinstmctionatyear a parent survey will be conducted by t^^ 
documented by a summary of responses obtained from s parent sun/ey conducted by the program 
evaluator. 

• ■ 

Evaluation mPlhftfl 

During the 1987-88 school year, the parent survey that had been used for a number of years in the 
Chapter I Program was completely revised. This was done in response to a recommendation made In 



the 1986-87 Report of Evaluation for Chapter I Reading and Mathematics Programs. TWs 
recommendation suggested that a more comprehensive questionnaire be designed that would 
hopefully fK)t only be a better instrument for gathering information from parents about their perceptions 
of the new Des Moines Plan, but would also yield a better rate of return than had been experienced In 
the past. 

•me seven item revised instrument, a copy of which appears in Appendix IVW.M- B was sent to a 10 
percent random sample of parents of all Des Moines Plan lab students on April 15. 1988. Three 
hundred eighty five questionnaires were sent out via U.S. mail. 61 or 15.8 percent of which were 
returned. While this represents a slightly better rate of return than had been experienced in previous 
years, it is nonetheless insufficient for making generalizations to the population of Des Moines Plan 
parents. Results of the survey are summarized in the $laloments below with the qualification that 
gorieralizaiions cannot be made from the responses of this sample to the population at large. 

EfisuHs 

- Forty five of the 61 respondents (73.8%) agreed or strongly agreed thai they were 
satisfied with information they had received about the Des Moines Plan. 

t 148 
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. - The process for selecting students for participation in this program satisfied 36 (61.1%) of the 
59 parents responding to this question. Thirteen (22.0%) were not satisfied to some degree. 

- Of the various ways In which parents are contacted by Des Moines Plan lab teachers. 64.0 
percent of the respondents preferred scheduled conferences. at school with The Des Moines Plan 
teacher. Only 2 (4.0%) Indicated preference for home visits by the teacher while 9 (18.0%) preferred 
telephone calls. 

- Thirly-one respondents (67.4%) felt that letters provided the best avenue for obtaining 
information about the District Parent Advisory Council and its activities. 

- Over one half (56.3%) of the respondents felt that brochures and information about learning 
activities for use at home would be the rtxsst useful items that c^uld be provided through the Parent 
Advisory Council. 



AlthougirthWeTurnTatiTmpToVrd sli^ Chapte"r I surveys), the 

number of returns via U.S. mail was still far from that necessary to allow for generafizations to be made 
from the sample to the population. This is unfortunate as costs are involved in designing, printing and 
mailing such an Instrument. Given this situation, it would seem feasible tp consider giving parents an 
opportunity to complete this survey during conference time as many participate In this activity. This 
•would increase the response rate and could be set up in a way that would Still ensure anonymity of the 
respondents. 

PROCESS AND PERFORMANCE OBJECTIVES 
Middle School Reading/ Writing Lab Program 
ObiGClive II R1 

During ihe instructional year, the coordinator will organize and maintain an accouniBbility file arvf 
provide copies of data to support the evaluation of all objectives as documented by accountability files 
maintained by Ihe program coordinator and the Department of Evalcntion. Research and Testing. 

Results 

Duplicate accountability files were maintained in the Des Moines Plan Olfice and the Department of 
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Evaluation. Research and Testing during the 1987-88 school year. Periodic checks were conducted 
during the school year to assure that data to evaluate program objectives were being collected. The 
data were submitted to the Department of Evaluation. Research and Testing at the end of the program 
year. 

Obiedivfi III 

At*he end of the instructional year, lab students, grades 6-8, who have been enrolled in the 
pr.jr&m for at least 80 days will demonstrate sn increase in the percentile rank from pre to post test on 
the vocabulary and comprehension subtests of the Iowa Tests of Basic Skills (ITBS) as documented by 
accountability files maintained by the program coordinator and the Department of Evaluation. Research 
and Testing. 

Obiectivff III 

At the end of the instmctional year, lab students, grades 6-8 who have been enrolled in the program 
4or.alleast.Bq days.willdemonstrateaproficiency.on the-vocabulaiy-andreacVng comprehension- ^ - 
subtests of the ITBS. such that the average gain in normal curve equivalents (NCEs) will be at least 3.0 
3s documented by scores from fall and spring testing, submitted to the program evaluator at the end of 
the Instructional year. 

Evaluation MPl^of^ 

Students complete the vocabulary and reading comprehension subtests of the lowc Tests of Basic 
Skillc i.n October and April of each year. Raw scores obtained by these students are ultimately 
converted to percentile ranks and norma! cy.-ve equivalent (NCE) scores. Objectives III A1 and III A2 
specify criteria for the gain in the NCE score between pre and post testing. 

Tables fVW-8 and fVW-9 present data that are necessaiy to evaluate objectives II! A1 a.-vj !!! .\Z. 
Narrative pertaining to these objectives follows the tables. 
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Table mf 8. Vocabulary and Reading Comprehension Iowa Test of Basic Skills' 

Grades 6-8 (Percentile Rank) 





Vocabiit;^fy 






fieadi 


no Compreh*?nsion 


Grade 


a 








a 


Eis. 


Esisl- fiaiQ 


.6 


142 


29 


30 


+1 


142 


22 


26 +4 




135 


29 


25 


-4 


135 


22 


23 +1 


8 


134 


22 


27 


+5 


134 


1.9 


.21. +2 



Table Vocabulary and Reading Comprehension fowa Test of Basic Skills 

Grades 6-8 (Normal Curve Equivalents). 







Vocabul^^ry • 




Reading Comprfjhpnc,jr| 




N 


El& 


East 


Gain 


N 


£££ 




€ 


142 


38.2 


39.2 


+1.0 


142 


33.9 


36.5 +2.6 


7 


135 


38.0 


36.0 


-2.0 


135 


33.5 


34.4 +0.9 


8 


134 


33.9 


37.4 


+3.5 


134 


31.0 


33.2 +2.2 


6-8 


411 


36.7 


37.6 


+0.9 


411 


32.8 


34.7 +1.9 



Students demonstrated an increase in the percenlile rank at grades 6 and 8 in vocabulary and in 
grades 6. 7 and 8 in reading comprehension. The percentile rank for studcnis in grade 7 on the 
vocabulary subtest decreased by 4 points. (OLjective III Al) 

Objective III A2 states that studenis in gr.des 6. 7 and 8 will demonslrale an increase of 3.0 NCE 
«ni1s in bom vocabulary and reading comprehension sublosts of the Iowa Tests of Basic Skills. 
.--0^ccprding lo Table RAV 9. the weighted average r ' '.C gain for studenis in grades 6-8 was 0.9 in 
vocabula^ and 1.9 in reading comprehension. This compares to gains made du.ing the previous year 
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Tor sludenis at these grade levels ol 0.4 NCE units in vocabulary and 2.2 units in reading ' 
comprehension. The gains demonstraled by students at the middle school level on ,he vocabulary and 
reading comprehension subtests have consistently (ailed to meet specified criterion levels. This would 
mdicale a need lor continued emphasis at the middle school level in order to improve achievement. 

Obiectlvff III a; ^ 

By the end of the instructhna, year, lab students. grades 6-8 w,.o have l^eer^ er^roUedir^ the 
program Ml display a rr^re positive atUlude toward learning than they displayed at the time oUheir 

to the program evaluator at the end of the instructional year. 

Evalu ation mftthp j 

Des Moines Plan Reading^riting lab students at the middle school level completed a pre/post self 
evaluation Instrument designed to measure attitude toward various academic activities. The instr.-nent 
-used replaced the Self Anchoring Attitude Scale, an instrument used in the Chapter I Program to 
n^easure sludent attitudes lor a period of several years. The instrument, a copy ol which appears in 
Appendix RAA,. M- C. consists ol two rating scales. The first asks students to rate their daily behavior 
according ,o seven descriptors, i.e. - completing work on time." " participating in class." etc. on a 5 po^nt 
scale (l_-never 5=always). The second section asks students to rate their attitude in class usi.ig the 
same five point scale as it appllos to eight adiectives. Four of the adjectives are positive ("helpful." 
-interested.- -respectful- and "improving-, while four are negative ("disruptive.- - disinterested.- 
-disrespectful- and "a problem") and meant to represent oppositcs of the positive adjectives. The r.-,ost 
tavorable attitude would be indicated by a response of "G" to the posili.o.ndjoctives and a responro of 
to the negative adjectives. 

Severat problems arose io the administration of this i.ctrumon, ,o middle school ro.ding^vri,i„a |.-,b 
lludents in 1987-68. The most signiticanl problem w.,s ,ho (act that al several buildings students did 
; ; ^ not complete the altitude scale in bpth the fall and sprin, to create a pro,,ost measurement as ind;.,iod 
W id 
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by the Objective. Another problem was the fad that there was no way to determine wheth^rstudenis 
wmpleiing the inslmmeni were doing so as part of a reading or a mathematics lab class. Tables RW- 
10A and -1 OR report the results (or the portion o( the scale dealing with attitudes toward class (or those 
buildings where Des Moines Plan students completed the instrument on a pre/post basis. Table R/W- 
10A indicates results (or the positive attitudes while fable-1 OB indicates resutls (or negative attitudes. 
Table RAV-10A. .Altitude Scale Results (or "Positive" Attitudes 
Des Moines Plan Middle School Students 1987-88 



School: 

Calfa.nan 

Goodreil 

McCombs 

Meredith' 

Metro 



17 

33 
39 
41 
2 



Helpful 

Pre Post 

3.7 4.1 

4:2 3.7 

4.0 3.7 

3.6 3.6 

3.0 3.5 



Inlerestpfj 

Pie -Post 

4.0 3.8 

3.9 3.7 

3.7 3.6 

3.6 3.4 

3.5 3.t 



Pespectfi;! 
Pre Post 

4.5 3.9 

4.3 4.0 



4.1 

4.0 

3.5 



4.1 

3.5 



Improving 
Pre Post 

4.2 4.4 

4.0 4.2 

3.9 3.8 

4.0 4.0 



3.5 5.0 



All Schools 132 3.9 3.7 



3.8 3.S 4.2 4.0 4.0 4.1 

• Not administered on a pre/post basis at Brody. Harding. Hiatt. Hoyt. Jm^^^ 

Table H/W-IOB. Attitude Scale Results for "Negative" Attitudes 
Des Moines Plan Lab Students 1987-88 



School 




Pre f?ost 


i2i5iQle.r.C5jfiSi_ 

Pre Post 


JJismscficiful 
Pre Post 


A ProbifffT) 
Pre Post 


Callanan 


17, 


1.9 2.0 


2.0 


1.6 


1.5 


1.5 


1.7 1.5 


Goodreil 


33 


2.0 2.5 


2.1 


2.3 


1.8 


1 .9 


2.1 1.6 


McCombs 


39 


2.0 2.4 


2.2 


2.6 


■1.7 


1.6 


2.1 1.9 


Meredith 


41 


1.9 2.3 


2.4 


2.5 


1.9 


2.4 


1.6 2.1 




2 


2-5 2.0 


25 . 


.3.5 


.25. 


20 




MSchQoJs 


132 


2-0 .23 


22 .. 


24 


.1 5 


. 19 


... 20 .L5 
1.9 ij? 
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•ftom toMime of pro measuren,..,,, ,he ,ime ,i, pos, moasu-emenl. improvomon, m atoude would 
Mcodon ,he poin, soale by ,-,n tooa.^ „e seal, value ,o„he positive dosoriplors and a 
decease In ,he scale value lo, ihe n.:.-,Uve descdplors. Examlnalien o. Ihe scale value for all schoote 
rn*ales ,ha„c, ,he poslllve adjec,lv« (-.eiplul;- -inleresled - --espeCul,- improving-,, ,ne scale 
value anuaty decreased torn pre ,o .^sl measuremen, ,o, all descnpicrs excep, -improving- which 
sho«d a sligh, increase. For ,he ;Vo doscriplcs. a decrease ■„ scale value would indicate 
i..proven,en, in altilude ,rom the pro to the pos, measure. Table R«-,OB, however, shows.tha, 
value increased lor all areas except v,;ah showed a slight decrease. 

su„..-.a„. the results present,-... Ta*s tvWtOA and ,0B indicale an i^rovemen, in attitude 
.rompretoost measurement, or o.:> t.™ otthe eight descnptors. Tho resute must be qua«,ied with 
.he ,ac, ,ha, no data tor matching st,,.-; on a pre^^ost basis were received trom six middle schools. ,n 
addiiion. the response sheels subn:-.-.- « no, in*a,e whether the student completed the 
in«-....ce™ i.. the readingwing lab o, -..■,;,.,,ma,i=s lab which r,«de the sorting process even „„re 
difficult. . 

■ DJiiediveJlLM 

By the end of the insiructional yoar, s'.udonis nrarto^ r a 

i . ...s^ b.L.ai,nis, grades 6-8. who have been enrolled in ^the 

;.%.an, .or a, feas, 80 re.r^^^,„.„y ,„ ^^.^ ^^^^ 

^«on^ ,o,„g a,ua/ ,0 org,oo:o, „■ -n ,„,, ol m no..,a, sMon,s in me .an,«c/,oo/s a. 
<-~...6,a..e,^a,,ce/pa/e.,.:....c,,epo.s,s„^n,^^^^ 
prcQram coordinator and program cvrAjalor. 

Teachers report the number o, ,• .. s,uden, a„ended d„ring each semesie, an. ,he number 

ord..yso,p,«ib,ea„endance. n.. :.v,3 i. accomp,isl,edby „,e,eachercon,p,e,ing a pres,ugged 

d u I . oonidcl Form. The mfonnai.on on Ihis form is entered on 
1:0 d.!.bn.c. and suf,sc.r,,on. sun.onry .v->„s arc produced wLcl, allow for eval„nlion of ,his 
objodive. 

er|c 
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Obiectfve HI A4 states tt.at the attendance of Des Moines Plan lab students enrolled m the prog.^am 
for 80 days will display a rate of attendance that Is equal to or better than that of nonprogram students in 
the same schools. Emphasis on the importaxe of school attendance has been a priority In the 
Chapter ! Program since its inception and continues to be considered such in The Des Moines Plan. 
Table R/W-1 1 displays the attendance rate (indicated by days attended as a percentage of days 
possible) for Des Momes Plan and non.pes MolnisPlan^ 

Table R/W 1 1. Attendance Rate D.M. PlarVNon-D.M. Plan Middle C.hool Students 

1987-88 





Des Moinp<; plan 
U 'Percent 


H Percent 


Brody 


§9 


96.4 


580 


91.6 


Calianan 


52 


87.3 


574 


94.0 


Goodreil 


63 


89.3 


712 


92.5 


Harding 


138 


93.7 


658 


84.0 


Hiatl 


60 


88.4 


486 


91.6 


Hoyl 


61 


93.9 


496 


92.9 


McCcr.Jjs 


41 


91.0 


560 


93.1 


Meredith 


62 


92.8 


595 


94.6 


Merrill 


41 


92.0 


494 


94.5 


: Metro 


14 


46.2 


109 


68.9 


SrVeeks 


72 


92';8 


604 


93.0 


■All BuilfJihgs 


653 


88.9 


5868 


92.8 



As indicated by Table R/W-ll. the allendance rale for Dos Moine. Plan Reading'Wrii 



The middle school level was 88,9 perceni compared to 92.8 



Writing students at 
percent for nonlab sludenis at the same 
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buHdings. At two buildings. Brody and Hiatt. Des Moines Plan students actually displayed an 
attendance rate higher than that of nonJab students. As the overa.'. attendance rate lor Des Moines 
- Plan students was lower, this objective was not achieved 

■ Objective IV 

By September 18. 1987. lab teachers will have selected students, grades 6-8 asr'.ocumer^ted by 
lists ot students (by grade level) who were selected tor instruction and the rank order checklist, 
submitted to the program coordinator with September accQuntablllty data. 

Evaluation Mft|^^^r} 

The Des Moines Plan was not officially implemented until Januao^ of 1988 following the first 
administration of checkpoints. However, as staff was h=^ed at the.beginning of-l9b7:88. students were 
lentatively,iden,ified and served beginning in September. On November 17. 1987. initial class lists 
^ were produced from information contained in the database at that time. The inclusion of a student in the 
database and subsequent appearance of his/her name on class lists indicated selection for the program. 

Result*? 

Table R/-12 Shows the number of sdtudents that were originally identified at each attendance 
center by prade level for the reading'writing labs. 
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Table RyW-12. Number of Students Served Des Moines Plan ReadingWriting L^bs 
(Middle School) as of November 17, 1987 



Building 


Number of Sludenis served by Grac;^ Level 
S 7 


8 


Total 


Brody 


24 


22 


1 o 


58 


Callanan^ 


1 A 


10 


U9 


33 


Goodrell 


15 


17 


20 


52 


Harding 


48 


51 


w 1 


130 


Hiatl 


13 


13 


27 


53 




09 


13 


26 


48 


McCombs 


19 


15 


12 


46 


Meredith 


34 


09 


M 


54 


Merrill 


18 


10 


12 


40 


Metro 


04 


03 


04 


11 


Weeks 


19 


36 


16 


71 


All Buildings 


217 


199 


180 


596 



As cah be seen from Table fVW-i2. 596 students were initially identified for participation in 
/DOS Moines Plan noading/Writing Lab classes at the middle school level. 

Efforts are currently being made to develop a revised Dos Moines Plan enrollment document that 
-(i reduce the amount of data entry performed by The Des Moines Plan clerical staff. This step should 
elfow for generation of initial Cass lists in a much more timely fashion. This objective was achieved, as 
Ihe actual process of student selection was completed by the specified date. 

Curing the Instructional yoar. lab teachors will develop and maintain an ICR for each studont 
receiving tab instruction as documented by ICRs on file with the lab teachers. 
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Evaluation Mftt^^^rf- , 

Oes Moines Plan consultants examined Individual Educational Plans during visits to buildings. At 
the end of the first semester, the consultant initialed the ECucational Plari Summary Sheet to indicate 
lhat the plan for each student had been reviewed. 

R6sult«; 

individual Educational Plans were developed and maintained for each Des Moines Plan student. 
The educational plan includes e'tisting of obiectives to be introduced to each student and various 
teaching strategies that will be employed to achieve the obiectives. One of the functions of the 
pes Moines Plan consuttanis is 'to monitor the recording of info rmaticr. for each studen, on the 
educational plan. As mentioned above, the consultant initials the educational plan during visits tea 
buiWing to indicate that the necossao^ information has been recorded and that the plan itself is being 
carried out. 

Obieclive IV P3 

Curing the ins.ruclional year, lab teachers will instruct 55-75 students for an average of 45 minutes 
daily as documented by lab schedules, submitted to the program coordinator by September 18. 1987. 
s-d resubmitted each time a schedule change is made. 

£" iialioiLMuM 

Lab teaching schedules were submitted by all Des Moines Plan teachers as classes began in mid 
September. Revisions were submitted as necessary. 

Schedules indicated the lab teaching schedule and number of students served in each.group. 
Other information appearing on the schedule includes the time that the lab teachers and appropriate 
classroom teachers plan jointly. I.ab classes at the middle sclx^ol level met for one class period or 
approximately 45 minutes daily. Full time teachers served a range of from 55 to 75 students during the 
Iday. 
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Obiec1ivt'> IV R4 

Byrne enrfof to hslmcbn^! y,a, leb teart«« U:-. had personal contact mh 
pa,onts.'oua„r.ans Cat .-.as, 50% o«/,. totatnunte, of .-..Cents, grades e-e. whh nave been enrotled 
/n ,/,.p™s,am ,0, a»»,«,ja^=,s a. , ,,,,,,, ^^^^^^^ 

■tbe K,ay accountat,my data to the program coorrfmator. r , program e.aluator,and building 
principals. 

EvaluatiQn M -'^-hod 

Oes Moines Plan loaches oomplolod a p,os!.goo,) -•..,,„aa„ooa,>l Parent Oonlact Form- al ihe 
en, 0. each sen,es,e,. Tl,e..6rm indteales ,he days por- lo ,o. a,,onoance during ,he semester, the 
da,s attended and the number ot home visits and perco : contacts n-,ade by the teacher to the parents 
ot oach studem. The terms are scanned by Mid towa C. .....,or Center, the Intorma.ion becotnes a pad 

ol Ihe database and summao- 'opods are producer, why • ■i:c-.v to, evatuation of these obieclives. 

BfiSLdlS 

Obiectivo tV B4 states tt„t the parents o. at teast S" , ..cent o. the students in tfe ReadingWriting 
lab Program enro.led to, 20 c, mere days woutd be cor. personatty a, some time during the schoo, 
yoar. ™e critena estabtished lor parent contact at this Ic-. v. ore less st,i.ngenl than at tha elementaty 
level Which spocilic-d contact wld, parents during each r,- rather i:,an lor the entire yea,. 

■Personal conlac,- implies a visit by the teacher to the 1 cl a student, a visit by the parent to school 

ora telephone call m,^e by the teacher to the parent. n.,-,:n,ontation subn,illed revealed that personal 
contacts were made to the p..,ents ot 74.7 percent o, ,t.. ■ r.,,,,-.„.s enrolled 20 days o, more, thereby 
o^cecding the specilicd criterion. At only one middle rxl;- .-1 ..llendance cenle, did the rate lall below 
SOporcem. At ar,olhe, l.,..;td;r,o, Harding Middle School, , .onl., ol 86.6 percent ol tl,e students were 
ponlaclod TJiis c!^joc!ivo was nchieved. 



pi>jcciivc iv ng 

nylho cnu-oftho InsUucUonai yoar, lah toachcc v. ':U,.o completed a minimum of 



o ne parent 
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^"'O'^^'T^^nractiviiy as documented by Parent ActivH^ 
coordinator by the end of the instmctional year. 

Evaluation Mt^lhfff} 

Lab teachers submitted a document entitled Pareni ActivHy Planning Sheet that contained 
lOformation about activities provided for parents of students in the lab program to document this 
objective. 

Resulifi 

Parent Activity Planning Sheets most frequently reflected activities that included inviting parents to 
visit the labs at a specified time at which they could see and participate in various lab functions. In 
severaf cases, use of computer wort^stations were demonstrated and parents were then encouraged to 
participate-in a,computer activity. In rnany cases, the activities were provkied at either conference or 
open house time. Activity sheets were received from all middle schools with the exception of Hiatf. 

Obieclive Vi 

'^'^'^'^^^r.^i Of the instructional year, a parent survey be conducted 
documented by a summary ofresfJonses obtained from the parent survey on file with the program 
evaluator. 

E'^aiuation method 

During the 1 987-88 school year, the parent survey that had been used for a number of years in the 
Chapter I Program was completely revised. This was done in response to a recommendation made in 
the 1986-87 Report' of Evaluation for Chapter I Reading and Mathematics Programs. This 
recommendation suggested that a more comprehensive questionnaire be designed that would 
hopefully not only be- a better instrument for gathering ir nation from parents about their perceptions 
Of the new Des Moines Plan, but would also yield a better rate of return than had been experienced in 
the past. 
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The.,,ve„ revised i„s,™™n,. aoopy o,„hfc. appoa. in Append. !VW. M.B.assen„o a ,0 
percen, random sanrple o,.pa,en,s o, all Des Moines Plan lab studenls on April ,5. ,968 Three 

•«'"^-^^'S^V.ive,ues,ionnaireswe,ese„,ou,viaU.S.mail.6,or,s.8percen,o,which«ere 
.elurned. W^»^<^is-P-en,s a sl,h„be„e, rale C-relurn,. an had been experienced, n previous 
yoar.. i, is nonemeless insuliioien, ,o, making generali^alions ,o ,.e pb^lalion o, Ces Moines Plan 
parents. Resulls o. Ihe sun,., are summanzed in ,.e slalemenls below wi,. „e ,ual«ica,ion ..a, 
9enera,.a,ions canno, be made from I.e responses o, ,his sample ,o ,.e pop.lalion a, la^e. 

ResiiUs ■ 

- Forty live o( ,he 6, respondents (73.8%, agreed or strongly agreed that they «ere 
salistied-wilh information they had received about the Des Moines Plan. 

- T''»P--='°-*c,ingstudents,orpa*ipationinthisprog,amsatis,ied36,8n%,o,the 
: .( 59 parents respondi^ to this r^estion. Thideen P2.0.,, were not satisHed to some degree 

- O, the various ways in which parents are contacted by Des Moines Plan lab teachers 64 0 
percent «, the respondents preferred schooled contere^es at school with The Des Moines Plan 
.eacher. Only a <4.0%, indicated preterence to, home visits by the teacher ,vhile . „B.«, preferred 
telephone calls. 

- Thirtyone respondents (67.4%) fel, that tetters provided the besfavenue for obtain,^ 
■nfomralion about the Distnct Parent Advisor, Council and its activities. 

- over one half ,56.3%, o, the respo^ents fel, that brochures and information about teaming 

^Advjisory Council. . 

A«hough the return rate improved sightly ,rom ,hat in previous years (using Chapter , surveys, 

^mode „om ,he sample to the population. Th. is unfodunate as costs are involved in designing 
pnnting and maKng suci, an insl.ment. Given this si,u,3iion. i, „ou,d so.m feasible ,o .»ns*r giving 
parenis an oppoduni,y ,o comp,o,e ,h. survey during conference time as many padicipate in this 
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activity. This woulc :ease the response rale and could be set up in a way that would still ensure 
anonymity of the respondents 

PROCESS AND PERFORMANCE OBJECTIVES 
Senior High Reading/Writing Lab Program 

ObiGctivg 11 

During the instructional yea, the coordinator y^ii, organize and maintain an accountamy file and 
P^'^'^^<^P'^s Of data to support the evaluation Of all ot^J^^^^^^^ 

maintained l^y the program coordinator and the Department of Evaluation. Research and Testing. 

Results 

Duplicate accountabilily files were maintained in the Des Moines Pian Cice and the Department of 
• Evaluation. Rese.^ch and Testing du'ring the 1987-88 school year. Periodic checks were conducted 
during the school year toensure that data Jo evaluate program objectives were being colleded. The 
data were submitted ,o the Department of Evaluation. Research and Testing at the end of the program 
year. 

i2!ji£Cliv£LJllAl 

At the end of the instnjctional yea, lab students, grades 9- 12. ^ho have t^oen enrolled In the 
program for at leas, 80 days .ill demonstrate an increase in the moan percentile rank from pre to post 
test on the reading sut^test of tha lo.a Tests of Educntional Development (ITfSD) ,s documented t>y 

''<'^''^^om fall and spring testing, sut^mitied to the program ovalu,tor at the end Of 
year. 

Atlf^e end of the instnjctional yea, lab students, grader, 9- 12 v^ho have been enrolled in the 
■program for at least 80 days .ill demonstrate a proficiency on the reading sables, of the ITED. such that 
fa average gain in normal cun^e equivalents (NCHs) .ill bo a, loas,3.0as documented by scores from 
f^ff^^d spring testing submitted to the program cvalualor a,, he end of, he inslruCional yea. 
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C-valuatinn t 



St-dents complete the reading subtests of the Iowa Tests of Educational Development In October 
and April of each.year. Raw scores obtained by these students are ultimately converted to percentile 
ranks and rx^rmal curve equivalent (NCE) scores. Objecrves III A1 and III A2 specify criteria for the gain in 
the NCE score between pre and post Jesting. 

PesuHs 

Tables RAV-13 and RAV.14 present data that are necessary to evaluate objectives III A1 and III A2. 
Narrative pertaining to these objectives follow the table. 

Table RW-13. Reading Comprehension Iowa Test of Educational Development 
Grades 9-12 (Percentile Rank) 

^ n Em 

9 118 24 27 

° No Students served in 1987-88 

^ No itudents served in 1987-88 

^ ^ No students served in 1987-88 



Table RW-14. Reading Comprehension Iowa Test of Educational Development 
Grades 9-12 (Normal Curve Equivalent) 



Gain 

+3 



^ 118 34.9 



Gain 

37.0 +2.1 

^ ° No students served in 1987-88 

' No students served in 1987-88 

No students served in 1987-88 
students in gmdo 9 demonstrated an increase in the percentile rank on the reading subtest of 3 
units. The increase iiotween pre and post testing using the Normal Curve Equivalent scale as specified 
O ... 
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in objective III A2 was 2.1 NCE unHs. The criterion for achievement gain at this fevel was 3.0.' 
Comparative resutls are not available from previous years a.-.e Chapter l/ll Programs had not served 
students at these grade levels in recent history. 

Obiectfvfi II I 

Bv Ihe end of the inslrvctional yea, tab students, grades 9.12. wt^o t^ave been enrolled in the 
P'^Sr^^foralteastSOdayswnidisplayarn^ 

the time of their entrance into the program as documentod by the prefpost Attitude Toward Learning 
sunrnary. submitted to the program evaluator at the end of the inst.vctional year. 

Evaluati on mpihp f j 

Des Moines Plan Reading'Writing lab students at the middle school level completed a pre/post self 
|. evaluation instmment designed to measure attitude toward various academic activ«ies. The instrument 
used replaced the Self Anchoring Attitude Scale, an instrur^ent used in the Chapter I Program ,o 
measure student attitudes for a period of several years. The instrument, a copy of which appears in 
Appendix RAV. M-C consists of two rating scales. The first asks students to rate their daily behavior 
according to seven descriptors, i.e. completing worK on time, participating in class, etc. on a 5 point 
S^te (1=never; 5=aKvays). The second section asks students to rate their attitude in class using the 
same five point scale as it applies to eight adjectives. Four of the adjectives are positive ("helpful." 
•inloresled.- -respectful" and" improvinQ") while four are negative ("disruptive." "disinterested." ' 
•disrespectful" and 'a problem", and mearit to represent opposites of the positive adjectives. The most 
favorab.0 attitude would be indicated by a response of "5" to the positive odjectives and a response of 
*r lo the negative adjectives. 

Several problems arose in the administration of this instrument to senior high school 
•eadingWrithig Lab students in 1987-88. The mo..t .cianificant problem was the fact that at two 
buifdings. students did not complete the attitude scale in both the fall and spring to create a pre/post 
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■measuremen, as indtealed by ,he obieaK-e. Anoihe, problem v,as ,he faC ,ha, ,ho,e was way ,o 
de,em,i„e whe.her s,uden,s comp.eling ,he insl^men, were dolsso aspa. oU.readi^ or-a- 
™.hema,ios ,ab Oass. Tables R/W.,5A a™, .,58 report ,^ resu.s ,or ,he t»*„ o, ,he scale deali,« 
wllh alllludes loward class .or those bullolr^s where Des Molhes Plah sludenis compleled ,he 
insla^mem on a pre/posi basis. Table R«-,5A Indlcales resulls .or ,he posLlve aMudes Table 
aw-i5B indicates resulls for negative attitudes. 

Table RAV-15A. Attitude Scale Results for "Positive- Attitudes Des Moines Plan 
Senior High School Students 1987-88 



SchoQj 



SfihfiSl 

Hoover 
Lincoln 
Roosevelt 



BeiptuJ 



Pre Posi 



F?espef:lf|;| 
Pre Post 



jmproving 

Pre Posl 



Hoover 


11 


3.8 


4.0 


3.7 


4.3 


4.2 


4.5 


3.8 


4.0 


Lincoln 


07 


3.9 


3.0 


4.1 


3.4 


4.4 


3.3 


4.'. 


4.4 


Roosevelt 


05 


3.6 


3.2 


3.4 


3.4 


4.2 


3.6 


4.0 


4.2 


All Schools 


23 


3.8 


3.5 


3.8 


3.8 


4.2 


3.9 


4.0 


4.2 



Table RAV-15B. Attitude Scale Results for "Negative" Attitudes 
Des f^oines Plan Senior High Lab Students 1987-88 



U 

11 

7 

5 



££fi__Ei2Sl 



2.1 
1.7 
1.8 



2.1 
1.7 
1.8 



2.7 1.6 
2.0 2.3 
2.6 2.2 



Pig. Post 

1.5 1.5 

1.4 1.7 

2.0 2.0 



Pre Poi^ 

2.1 1.4 

1.3 1.3 

1.6 1.6 



All Schools 23 



1.9 



1.9 



2.5 2.0 



1.6 1.7 



1.8 1.4 



I.e. 
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From ,ha ,ime o, pre moasursmen, ,o ,he ,ime o, pos, mea.u,emem, improvemen, in a(„,.de «u« 
be indicated on ,he «ve poin, scale by an increase in ihe scale valurio, pos«ive descdp,c,s aM a 

decrease in ,he scale-value .c,nega,^edescrip,crs.E«mina,ionc, me scale v^ue .or all sd^ls 
Wicales ,ha, ,c, posilive adieclives (-helplul,- -inle-esled,- TespecBul.- ■imp,oV.g-, ,.e scale value 

*c,easedin,«a,eas,.,elp,u,,-,espec«ur,.,emainedinesame,o,-in,eres,ed-a^inc,eased,or 
-.mp^oving.- Po, negalive desc-iplcs, a decease in ihe scale value wculd inc^cale an improvemen, in 
allilude „on, ,.e pre ,c ,he pos, measu.. Table R,W.,5B shews ,ha, ,ne value deceased ,c, ^vo 
descipiors. ■d-.in,eres,ed- and "a problem,- remained Ihe same ,cr -disorpiive- and increased ,or 
"disrespeclful." 

.n summaor, .he resulls presenled in Tables R/W.,5A and R«.,5B indicale an .mprcvemen, in 
a«ude ,rom pre ,c pos, measuremenl .or only ibree c, ,ne e^n, descHp,ors. The resu«s mus, be 
, W Qualffled. however, due ,o ,he occurence of ,he Mowing: 

a. Dala were received Irom only 3 ol the 5 senior high schools; and 

». From Ihe 3 high schoo. ,ha, submi„ed a„i,ude ins,rumen,s, only 23 malched pre/pos, ins,.men,s 
were found. 

_ e/"«*".'o,,/,.i,»«na,,ear,S6„„,.„,s,,ra<.esS.,., ^ „ave ^en en^,e„„ „e 

May aao«aMiy tfa,a /o ,/,e program cco,*a,o.r andp^,an, evaluate, 

£vnlu.a( iQn Mfitho (f 

Teachers repod ,he numb.r o, days each s,uden, anended durin, each semesie, and ,he number 
o. days 0, posswe a„endance. Popoding is accompiished by ihe leacher comple,i,ng a presiugged 
*cume„, enlilled -Allendance and Paron, Coniac, Form- The inlcmalion on ihis lorm is enlered on 
me dalabase and subsequeni summa^ repods are produced w..,icl, allow ,o, evalualion ol ihis 
objective. 
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Pesuits * 
Table R/W-16 Shows the a.lendahce rale (days present as a p.ercentage.of days possible) for Des 
Moines Plan students at each senior high building and for the to.al.enior high ReadingAVrrtingXab 
Program. Also indicated is the attendance rate for all s.uder.ts a. each senior high building and for all 
buildings combined (to yield a distrtct attendance rale). 

Table 16. Attendance Rale De^ Moines Plan Senior High Students 



All Schools 



BuHding 


D(?s 


iy^oines Piqr] 
Percent 


East 


35 


. 90.4 


Hoover 


26 


92.6 


Lincoln 


31 


■ 90.8 


North 


42 


87.9 


Rooseyell 


20 


93.0 



154 



AlL^ilusJfinis 
N Fei-cent 



2291 
1219 
2524 
1052 
1558 



91.8- 

94.4 

92.5 

91.6 

92.9 



90.5 



8644 



92.5 



AS Shown by Table RAV.16. me average a„enda,«e ,a,e to, a„ senior high s,uden,s in ,ne dislrfc, 
was 92.5. This compared lo an allendance rale of 90.5 lo, sludonis in Ibo Des Moinos Plan. The 
Oos Moines Plan allendanoe rale was lows, ,han lhal ,or all sludonis al all buildings wilh ihe excepfcn oi 
Rooseven. M lha, allendance cenler, Des Moines Plan sludenis had an allendance rale of 93.0 
compared ,o ,23 perceni for all sludenls. As Ihe speciftealion lhal D.^s Moines Plan sludenis would 



display a rale of allendonco higher lhan Ihe dislrici 



average was nol mel, this objoclivc was not 



achjeved. 



A process obiecive in Ihe middle school f^eadingWriling l.ab Program slales lh„l.,he allondance 

Students al the s.imc buildings. 



rale of Des f^olncs Plan sludenls will be compared lo thai of nonlab 



41-95 



The senior high o.,-ecnve on ,he .,he, ha,« does no, speo„y the corpan'son group as bei^ made up 

or on^rnon^ab s,«ien,s. Therefore. When repomngihe-auendanoe ra,e. records 6,« ,abs,udems 
«ere no, de,e,ed ,rom ,he ,o,a, group. For purposes of consferency and in order ,ob,,„er de«ne,,he 
tm groups. ,his obieoHve should be reused .0 ca« for, compar,son 0, a„endance .ales beK.een 
Des Moines Plan and non Des Moines Plan sludenis. 

Obiective IV f )i 

8ySep,e,.6er,ft,w.,aM.ac.e„.,,f.a.ese,ecrerfs,„deo,s.s,ades..,^«d«^ 
«sof sb*n,s 0,sra,e level) »fto .ere ielecle,! ,c, melruci>n 

submiltedlo the program coordlnalor mih September accour,tabmy data. 

• ' Evaliiallori Uf;\H<\ 

The Des Moines ■ n was no, officially Implememed un,ll Janua^, of ,988 foffowing ,he firs, 

adn.-nls,ra,ion of cheo.poin,s. However, as s,af, was hired a, ,he beginning of ,387-88. s,uden,s were 

.en,a,ivei, idenfflled and served beginning in Seplember. On November ,7, ,987. inllia, Cass ,is,s 

v-ere produced fro.. InformaUon comained in ,he dalabase a, ,ha, ,lme. The incision 0, a sluden. In ,he 

dalabase and subse^en, appearance of his^er name on class llsfs in*ca,ed se,ec,fen ,he program. 

fiesulls 

Table RAV-17 shows the number of students that were originally Identified at each attendance 
center by grade level for the Reading/Writing Labs. 
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Table RAV-^7. Number of Studenis Served Des Moines Plan ReadingWriting Lab 
(Senior High) as of November17, 1987 
Number of Students Served 



Building 


9 


* 

10 


By Grade Level 
11 


East 


37 


0 


0 


Hoover 


26 


0 


0 


Lincoln 


34 


0 


0 


North 


45 


1 


0 


Roosevelt 


16 


0 


0 


Ait Schools 


lis 


1 


0 



12 



Tota^ 



0 
0 

0 
0 
0 



37 
.26 
34 
45 
16 



159 



AS can be soon torn Tabte W-17, 159 sludonis wore mh ideniaied lor padfeipaiton In 
Oe. MCnes P,an Beadin^-Wra.ng Lab classes a, -e sonio, high level. .Nearly a« high school «„den,s 
Wany idenlllled were in Ibo 9lh grade and were selecled based on previous partlclpalion In Cbaple, I al 
.he mMe school level and olher sources prior ,o ,h, a«ua, implemenlalion ol Ihe Des Moines Plan. 

• Blods are curronlly being made ,o develop a revised Des Moines Plari;enrollmen, documen, lhal 
wi« «d„ce Ihe an>,u„, o, dale onl^ pedormod by Ihe Dos Moines Plan cMcal slall. mis slop should 
altovv lorgeneralion o. inilial Cass IS., in a r,>.ch n.re limely fashion. This obioclive was achieved as Ihe 
acuni process ol sludoni seleclion was complelod by ihe specllied dale. 

Ci!)il!£liS3L|VJ22 

'ocomns lab InslruCion as docmmod by group Cms on Ulo »im lab loaCors. 

Ecsuils 

• Group cha« wore rnainlnined by each leachor serving senior high sludenis in ihe noading^riling 
lab Program, iho group chads so^od much ,i,e same purpose as Iho Individual Hducalional Plan ,IEP) 
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which is developed for students a. the elementary and middle school level. Des Moines Pl^n 
- -consalta-nts mor^iiored the existence of ,he group charts at the time of regular visits to the buildings. 
This objective was achi6./ed. 

s.„n:,„e„o,neprog,an,coormna,or,ySop,en,,e, IS. m7. an, resubme, eac, Orr^ a 
Change in schedule is made. 

Labieaching schedules were submitted by all Des Moines Plan teachers as classes began in mid 
September. Revisions were submitted as necessary. 

^ HesiiUs- 

Lab schedules were submitted by e. s senior high teacher during the month of September. 
Revisions were made throughout the year as needed. The schedules indicated (he lab teaching 
schedule and the number of students served in each group. This objective was achieved. 

Obje ctive IV R4 

Every. ■ -^^eksMb toacters v^ill make personal contact ^llMh^ 
students, grades 9- 12. ^ho have been enrolled in the program for at least 20 days. 

Evaluation Mffth(Ti 

Oes Moines Plan teachers completed a preslugged "Attendance and Parent Contact Form" at the 
end of each semester. The form indicates the days possible for attendance during the semester, the 
days attende ; and tl number of home visits and persona, contacts made by the teacher to the parents 
OT each student. The forms are scanned by Mid Iowa Conputer Center, the information becomes a part 
of Ihe database and summary reports are produced which allow for evaluation of this objective. 

Objective IV B4 states that teachers will make personal contact with parents/guardians of all 
students enrolled in the program 20 days or more every nine weeks. The atlendance/pare.t contacl 
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if 



.epo« ,*a, lab teacher, complete are sub..i„ed for each semester ra,„er than each nine w'eeK period. 
ho*eve,. Therelore. « is only possible to detern,ne it such contact occurred during that time frame. ' 

During the lirsi semester, contacts wer, made with parents of 75.8 percent of the students served 
for a penod of-SO or more days. During the second semester, parents o, 77.6 percent were contacted 
It Should be noted that at Hoover and No.h. ,00 percent of the parents were contacted each semester. 
1. could not be detertnined whether or not this objective was achieved as written as parent contact 
inlormation was submitted by semester rather than by each nine week period. 

Ohiertivp V| B1 

near me enOo^e r>,s.r™«,b„a/y.., a pare,,, s.rvey »«e «,n,uce, ,y „e program evatratoras 
'^■^''''^>'y^^'"''^'ypl'e^r^eso,mne,,rom^eparer,,su^^ 



evaluator. 



Evaiuatinn M ^^t^T^^I 

Ou*g the ,987.88 school year, the parent survey that had been used lor a number o, years in the 
Chapter t Program was completely revrsed. This was done in respcso to a recommendation made in 
the ,986.87 Repo. of Evaluation for Chapter t Reading and Mathematics Programs. This 
recommendation suggested that a more comprehenshro questionnaire be designed that would 
hopeluH- not only be a better instrument for gathering inlormation from parents about their perceptions 
01 the new Oes Moines Plan, but wo.ld also yield a better rate ol return than had been experienced in 
Ihe past.. 

The seven item revised inslrumeni. a copy of wl.icl. appears in Appendix n/W. M-B was senl !o a 10 
perc-eni random sample of parents of all Des Moines Plan lab students on April 15. 1988. Three 
hundred eighty five questionnaires were sent out via U.S. mail. 61 or 15.8 percent of which were 
relumed. Whfle this represents a slightly better rale of return than had been experienced in previous 
.^ears. if is nonetheless insufficient for making generali.ntions to the population of Dos Moines Plan 
parenls. Results of the survey are summarized in the slatcmenls below with the qualification that 
gcheralizaiions cannot be made from the responses of this sample to the population at large. 
A 111 
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HesiiUs ' 

- Forty five of the 61 < aspondenis (73.8%) agreed or strongly agreed thai they were 
salisiied with information they had reteived about the Des Moines Plan. 

- The process for.selecling students for participation in this program satisfied 36 (6I.I0/0) of the 
59 parent, responding to th^s questior>. Thirteen (22.0%) were not satisfied ,0 some degree., 

- Of the various ways, in which parents are conlacled by Des Moines Plan lab teachers. 64.0 
percent of the respondents preferred scheduled conferences at school with The Des Moines Plan 
leacher. Only 2 (4.0%) indicated preference for home VisHs by the teacher while 9 (.18.0%) preferred 
telephone calls. 

- ThMy,one respondenls (67.4%) tel, ,hal lollcs provided Ihe bes, avenue lo, oblaming 
inlormalion aboul the DisWci Pareni Advisory Council and ils aclivHies. 

- Over one i,a» (66.3%) of ,he respondents fe« that brochure, and information about teaming 
activities lor use at l,ome would be the most useful items that could be provided through the Parent 
Advisory Council. 

Although the r.,u,n ra'e improved stightl,,rom tha, in previous years (usin, Chapter I surveys), the 
«.mbe, 01 returns via U.S. mail „a. stiti tar trom lhat necessary to allow tor generafeations to be made 
*om the sample to the population. This is unfortunate as costs are involvedln desoning, printing and 
n.a«ng such an instrument. Giv., this situation, it would seem feastole lo consider giving parents an 
opportunity ,0 complete Ihis su'rvey during conference lime as ma., participate in this aclivily. This 
>«>u«,increase the response rate and could be set up in a way lhat would still ensure anonymity o. the 
respondents. 

CONCLUSIONS 

Results Of the evalua.ion of porfc rmance and process objec.ives sugges, ,hat student at.endance 
and communication with parenis are ^.-o areas thai received strong emphasis in this program. In Ihe 
^Read|ng'V;rlting Program, parenis of approximately 83 percent cf the elementary studenis and 75 
percent Of both middie and senior high sludenis were contacted by telephone or in person during the 
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=^ year. ' 

4 -he ra,e of attondance for Reading/Wriiing Program sludenis was 88.9 percent of the days possible 

for middle school attendees and 90.5 percent for senior high. While criterion levels established by the 
g proposal were not.reached. these rates of attendance closely.approximate those for nonprogram 
studenj. at the middle and senior high levels - 92.8 and 92.5,oercent respectively. 

Student performance objectives involved administraiion of the Iowa Tests of Basic Skills and Iowa 
Tests of Educational Development on a pre/post basis as,a measure of growth. Criteria for achievement . 
included the amount of gain in th.o nomial curve equivalent score. Or, the reading comprehension 
subtest, established criteria wore exceeded when weighted averages were computed for grades 2-5 and 
1-3, Criteria were ret reached for grades 4-5. 6-8 and 9-12. 
^ Two conditions that may have adversely affected achievement gain during 1987-83 were: 
t (a) The Des Moines Plan lab programs were rrv^deled after the distrtefs Chapier I and Chapter il 

Programs: however, one third of the buildings involved in the lab programs had not participated in the 
Chapter programs. Although inservice training was part of the implementation process, unfamiliarity with 
the model and deliveor system could have had an adverse effect on achievement; and 

(b) The Des Moines Plan did not officially begin until Januao^ of 1988 following initial 
■ administration of . neckpoints. This resulted in a considerable shift in the siudent population at mid year as 
some students were ex«ed from the program and others were entered. The end result was that pre/post 
scores were available and included in evaluation results for students that may have received instructional 
benefits;for a shorter block of time than what would be expected. This would be particularly true for 
students at grade levels in which all pupils complete the Iowa Tools of Basic Skills or Iowa Tests of 
Educational Development in the fall. This condition bears mentioning though an asssumption is that the 
effect of it on the overall results for the program is probably slight. 

„ Condition (a) should be alleviated with th, passage of time. Steps will bo taken during the 1 988-89 
school year to eliminate test scores on the outcome measure for students that have not been served for 
an eslablishod iDngih of lime. 
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While there were at least t^^p instances in which proper documentation to evaluate process and 
performance objectives was not submitted (noted in recommendations section). It.appears from the 
evaluation that The Des Moines Plan ReadingWriting Program was implemented as called for in the 
proposal. 

RECOMMENDATIONS 

1 . The Supervisor of the Des Moines Plan should reassess the usefulness of the Principal's Report of 
Oes Moines Plan Supervision in the operation of this program. If this type of report is deemed useful, 
steps should be taken to ensure the more timely and accurate completion of this form. 

2. Proc. -.nd performance objectives related to the Writing to Read Program should be separated from 
Ihose the ..,y ,o ,he elementaor Reading/Writing Lab Program. The Writing to Read Program is a 
distinct program that serves hon-Des Moines Plan students as well as those that participate in the lab 

I Classes. In order to highlight this program, it would be best to treat it as a separate entrty. 

3. I, is recommended that the Des Moines Plan Supervisor take action to ensure that valid results mav be 
Obtained from administration of an attitude instrument to ail individual., forwhom it is intended. The value 
Of a pre/post measure is severely compromised when difficu«y occurs in n.atching results from the pre and 
post adminislfalions. 

4. It is recommended that continued emphasis be applied to encourage the improve.-.ent of student 
attendance. It would also be feasible to revis„e the objective for the senior high program so that it is 
cor^sistenl with the middle school objective in comparing attendance of program with nonprogram 
Students. 

'S. -it-is recommended that alternative methods forobiain:ng the perceptions of parents about the 
program be considered: It might be feasible to have an opinonnaire or other appropriate instmmenl 
completed at conference time or at another school activity that tends to be well attended by parents. 
Costs of designing, printing and mailing an instrument to measure perceptions are not warranted unless 
P^n adequate rate of return is encountered. 
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6. The developmenrof the process for measuring student performance using a locally deVeloped 
obiectives based instrument rather than a norm referenced test should be continued: Several conditions 
must be met in order to do this, but H is probable that benefits would be gained from measuring growth 
using an instrument that is closely matched with the districi curriculum. 

7. Cons,de,ration:shouId be given to limiting the involvement of the Department of Evaluation. Research 
and Testing in its monitoring of certain ongoing activities that are ,well incorporated into this program. 

. examples would include existence of Individual Educational Plans and lab schedules which are monitored 
on a regular basis by The Des Moines Plan consultants. . 
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Appendix RAV,M-A 
EnOClgalS-Repol of QOi_MQi nes Pl?.n Rii ppn/icipQ 
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School 
Date 



P«INCH>AL'S KEPOUT OF DL'S MOINL'S PLAN INSTRUCTION 



0" coordination of Classroom Teachers' and Lab 

Teacher's Instruction «-*^-ni.rb ana Lob 



Principal 's Siynature 



Classroom Teacher 



Direct 

Instruction 
to Lab 
J^isUatio^n .Students 



Date 



Time 



Yes 



JOINT 



Yes 



PLANNING 



No 



COMMENTS ; 





Duo by _f i V, t f r i d.,y | n J>.conjl)or , 

t- -o,^-. ...... ,.Uv„ ..e.;: ...^ , ^^^^^ 



n 
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Appendix R/W. M - B 
Baading^vritino. MalhpmffeLab_£fQQr am Parent .s.irvpy 



• Department of Evaluation and Research 
Des 5ytoInes Public Schools 
1800 Grand Avenue 
Des Moines, fowa 50307-3882 



April 15, 1988 

Dear Parent: 



^el^^'^A^^ot?^^''!?^^ an evaluation of The Des Moines Plan eacfi 

information when planningTe^fSgram Yn^flre yeLs^ ' ^ 

'^M^^'-^^^ ;-f3,i 

Thank you for your cooperation. 

Sincerely yours, 



John F. Tompkins 
Program Evaluator 




Alch 

--Parenr Survey, Des Moines Plan, 1987-1988 



PARENT SURVEY 
DES MOINES PLAN 
1987-1988 



Please indcate, Ihe e)c^e^^-^'^ u,k,vk , -^.-^ ..... „ - . * 

apprppnaie response: " " ' '"^ 'oliow sJalemenls by circling the 

the'Ses"Jo!res%,:f ' ^ave recerved about 

Strongly 

- ^''^^^ 5?-^9'ee_ Np9p™n„„, Agree - tgl'.T' 

parfi^,paf.^:,'t''The''iJe's Z.Js'V,::' »'"«enU ,o, 

Sifongly 

0«a9,ee ,Ksag,ee No opinion Ag-ee IX'" 

3. Persona! contacts between the <rhnni v 

Ponent of this program Which ^f .^ "^P°^'^"' '^O'^* 

communfcatlon have you had wfth vour ih?M.'°"n°^^"« '^P" 
-teacher during the past 'schoor1ea^'\ci;:c": "^'^^ 

Kome visit from The Des fvloines Pian teacher 

^Scheduled school conference with The Des Moines Plan teacher 

.^Des -Moines Plan sponsored aciiviifes/meelinQs- at the school 
Telephone calls from The Oes Wvines Plan laacher 



Home visit from The Des Moines Plan teacher 

_ —^Scheduled scbooLconfef ence- wiih-The Desl^loines Plan teacher 
_.„.Des Moines Plan sponsored aciiviiies/meeiings at the school 
Telephone calls from The Pes Moines Plan leachejL^^ 



. ,1 have, no particular preference for a certain melhod. 

PIHASE COr/PLtlTG THE OUHST.GNS CM THE RKV^HSE SIDE 01- TH.S SHEET. 



pa-anis ,o vote concerns o, make suggests abou,The p4,am 
Telephone calls 



Letters 

. . Brochures 

. . Public meeJinos 

'Other Please describe. 



. ^lo^ ZJ^ «'c.S •Se^^X-.r-" "'^ 
By telephone 

Through a building representative 

By attending a council meeting 

. . By responding to a survey 

,d| Olher. Please describe. 

\ ^ 

Info.mallon on how students are selected for the program 

'^"-'2^''P"°" of the program and How it operates 

- Information pertaining to evaluation of the program 
Information on 'earning activities^ lhaUan be done at„home. 

^f';"',^^;^ indicating activities related to The Des Wolnes 

Plan that occur during the school year. 

Brochures/handbook 
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Appendix RAV. M - C 
Beadino/Writinq M;.lhffmf^|;.. ( p.^grnm AllillJLli'Jkili: 
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SELF-EVALUATIOr 
^Secondary) 



Grade 



^^^ool ^ ^ ■ Date 



Directions : 

Rate yourself 1, 2, 3, 4, or 5 on each of the items befl 

Rating Scale: 

1 = Never 

2 = Seldom 

3 = Soirsetimes 
A = Usually 

5 = Always 

«y daily behavior incl udes - 

. completing work on time 

handing in neat work 

. following directions 

participating in class 

. listening to others 

usinc; class work tim.e 

working without disturbing others 



My attitude in class is: 
helpful 



interested 

i niprovi ng 

_ d i srupt i ve 

d i s i n t c- r o s t e13 

d i ?>rospoct f ul 

a problem 



Report of Evaluation: 

MATHEMATICS LAB PROGRAM 
1987-88 

Department of Evaluation, Research, and Testing 
1800 Grand Avenue 
Des Moines, Iowa 50307-3382 




John Tompkins 
Program Evalualor 
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INTRODUCTION 
Program Description 

Philosophy a|^^ ([^o^ic 

The undertying phteophy ot the malhemali« lab program te r^alhemalicr. is ol lhe ulrmsl 

imponance lo the educaltor, o( ot*ren. rrol only ,or «s uimiariar, values, bu, also tor its use ir, ,eaci,ir« 
logical thinking and problem solving. 

Accordi>-)g ,o slatemenis in the chapter of the official Des Moinas.Plan guildelines eniiiled 
-Philosophy of the Program." achievemeni in mathematics is improved when: 

(a) models are used by students as well as by instructors; 

(b) teacher expectations are high; 

• (c) leaching techniques help students to understand concepts; 
■ 
J (d) understanding precedes drill; 

(e) instruction is planned to meet student's needs; 

"--~^<^^-yis«OJCtion.is.basecf;onsequenli^ 

(g) parent involvement and interest are high; and 

(h) teaching objectives for mathematical skills go beyond computationio'lnclude.problem solving 
'applications. 

. (1) students will show growth in achievement as measured by pre and post tests; 

12) lab teachers now to the program will be assisted through insen^ice to learn leachm, strategies which 
use manipulalives; 

^ ^f^^~^^-^^i^«^s^will.parlici::.te.h.insen.ice-sessions-dosi^ 

teaching slralegies-with classroom mathematics teachers; 
^^(4) .lab teachers will implemoni computer-assisted instruction as a suppionioht to the existing curriculum. 
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(5) leaching objecives and educational plan forms will be reviewed. Recommended changes will be 
timed ,0 coincide wiih ,he new .ex.book adoption or wi.h adop.ion of a computer management system. 

iDSLo jctionai 

The Chapie, 1 Program is ,he insla,dional model used i„ ,he malhemalics labs. This model inc Was 
small group inslr..lfe„. diagnosis, masle,, learning approaches, individual educaltonal plans, a highly 
.«>.iva,ional.supplemenlal ouriculum (inoWing manipulalives). a>ord,nanon wilh classroom teachers 
and disinc, curriculum, parenlal involvemenl. i,.en.ice and support. <»mpu,e„-.ed record Keeping a,« 
effective teaching strategies. 

Isieniilii: iO-Erosiedmes 
ldenti,ica.<,n of sludenlriin need of addilional inslruclion is assured Ihrough checkpoinls. The 
.esls are a check ,o see a, whal point sludents are mastertng those subjects tor their appropriate grade 
level. The tests are given in grades 1, 3, 5, f and t ,. There were 37.75 luiltime equivalen, teaching 
positions in graces t-S: 8.2 ,„, chingpositi„ns.in grades e=8,and . .8 positions in grades 9-12. At the 
end 0. the school year. , .787 students wr-.-e served in the mathematics labs at the eiementaty level, .52 
were sewd in ihe n,-ddle scliool progrr-m and 126 were served in iho senior high program. 

BlidfleLaOd. Expenditnrg s 
The budgelary inlo,™alion to, the Malhematfcs^l,-ab Program lor the 1987-88 school year was 
.-.provided b^The Des Moinos Pten-Supervlsor in October ,988. Figure M- 1 below indicates the 
.unds allocated and e,ponded :n the.Mathomatics Lab Program for various line items included in the 
_b:£0«J5eloliaeprqp,ia!^^^ 

provided lh,6ugh Ihe tollowlng sources: IHducational Improvement Grant, Dropout Prevention 
Budgo,.nevievcehapterll,Ch.o,.rraWtlie-daia-Jg^^^^ 

.he allocations from each ,un*ng source to the overall Oes Moines Plan. Ouo tcthe method in which 
.budoe.ary.reco,ds-are main,ained; it woukihavo been an extremely jime consuming lask to determine 
Ihe anocationj^a,,5gainoi& from each separate funding source. Therefore, only the total 
amount alloi/alcd is reported tor each lino ilem. 
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FiS'jrs M.1. Budget and Expendilures Mathomatics Lab Pro-:- -r.n 1987-88 ' 



Calegory 




Expen-.;:!urp 


Salaries 


$1,589,415 


$1,324,407 


Fixed Charges 


200.394 


200.394 


Administration 


25.968 


11.980 


IndirectXosls 


35.662 


35.562 


Parent Component 


1.875 


1.786 


cvaiuaiion 


16.365 


16,365 


^poiiware/Maieriais/Supplies 


90.609 


95.095 


Inservice 


54.350 


26.769 


Telaphone 


• 1.200 


1.299 


Mileage 


2.250 


1.776 


Computers 


165.605 


251.873 


Classroom Reconfiguration 


11.500 


11.485 


TOTAL 


$;?,1 95.093 


$1.978./^3 


AS reported by tne Des Moines Plan S^ipervisor. October;T988 " ' 



During ,he 1987-88 school,yoar. $1,978,793 was expended to opeu..!. Mathematics l.ab 
erogram.. -This.represents.90.l-percer,t of the amount allocated: Tlio mr;--./ of the unspent funds 
are efigible for carryover to be used du.ing 1988-89. It should be notod !!:.-; ...'.o to the complexity of 

were necessary in order to generate Iho budget ir.formatior) in the above f:.>nal. 
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PROCESS AND PERFORMANCE OBJECTIVES 
Elementary Mathematics Lab Program 
Obiedivp II f^i 

The program coordinaform orgarilze and maintain an accoutamyiile and provide copies of data to 
''^PP'^^^^^^^'u^tion Of all Objectives as documented 
office and the.Department.of Evaluation. Research and Testing. 

Pesulis 

^ Duplicate accoutability files were maintained in the Des Moines Plan office and the Department of 

Evaluation. Research and Testing during th« 1987-88 school year. Periodic checks were conducted 
during ,he school year to assure that data to evaluate program objectives were being collected. The 
^ data were submitted to the Department of Evaluation. Research at the end of the program year. 

Qi2jfi£liyeJj_B2 

By November 27. 1987, elementary principals ^ill have monitored by classroom visits, the activities 
cfallfabjeachers and classroom teachers to assure that lab students are receiving direct mathematics 
instruction from the classroom teachers as well as from lab staff as documented by the Report of 
pes Moines Plan Supervision, submitted to the Executive Director of Elementary Education. 
Des Moines Public Schools, or the Superintendent of Schools. Des Moines Catholic Diocese, by 
December 4. 1987. 

* 

The Principal-s Report of Dos Moines Plan Superv ision submitted by each building principal was 
examined to determine evidence that lab students were receiving classroom as well as lab 1;;^;;^'"" 



The Principal-s Report of Des Moines Plan Supervision is an annual report submitted by efementa-y 
■ . 0)rincipnls in December to document that Des Moines Plan lab students are receiving insta.c,ion fro.^: 
, classroom teachers and thai joint planning is occurring between classroom and Des Moines Plan 
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teachers. A cop, ,„his lorm appea,s,,n Appendix RW. M- A. Documonlalion is gathered 6y pn'ncipals 
observi:^ a regular classroon, ,ha, iriciudes (.es Moir»s Ran sludenis and by observing p,annir,g 
sessions be,»een Res Moines P,an and c,a:^room teachers. The repod serves ihe same purpose as 

- ^'"'^ °' """" °' ' been compleled by 
elemehlary principals ol Chapler I buildings lor a number ol years. 

Several discrepancies were noted concerning ihis report during ihe ,987.88 school year. They 
were as follows: 

, (1) Nurepcr, was submitted by Ihe principals Of live b*ings. This occurred despite the (act that the 
Oes Moines Plan Supervisor sent a letter to all elementary principals dated March 3. ,988. to remind 
Ihose lhal had nol eompleted the report at that time to do so: 

- (2) A, (our buildings, the purpose o. the observatton was apparently unclear as the principals at those 
, fi sites observed lab classes rather than tegular classrooms: and 

(3) Obse^attons were m=>,at,e,.,he spec»ied date i:«leven cascs-in two cases, not.unti, March and 
April of 1988. 

Given that some principals had not been req-tred to submit this form previously. i.e. nrincipais o! 
hidings not served by Chapter 1. n is not surprising that the record o. submission anCaccuracy for this 
document was not as good as in previous years. Steps that might be.taK'en to improve,thi.-,situation 
would include more detailed instructions concerning completio:, of the torm and increased ellorts to 
-tollov.„p in.situation,.where-the forffi irsubmitted inac-curately or not at ar 
10 be made as to the requirement ,or nonpublic scl»ol principals to be involved in ihis aclivity. it would 
seem ditficullfor thesein«duals ,o observe particularly the Joint planning ettorts belween Des Moines 
-Plan.and^,:as.. -om .eachers when the Oes Moines Plan leachers to no longer serve students from the 



-norvwblic-buildiifranho non-public school site. 

SSjerljajJLAi 

// the and Of the instructional yoa, lab students, grades 1-5, .7,0 have Uoen enrolled in the 
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test on the mathematics composite score of the Iowa Tests of Basic Skills (ITBS) as documt>nted by 

''<>^''f^om fall and spring testing, submitted to the program evaluator at the end Of the Instm^^^^^^ 
year. 

Obiedivft III 

At the end of the instructional year, labstudents. grades2-5. who have been enrolled ir^ the 
program for at least 80 days will demonstrate a proficiency on the mathematics composite score of the 
tTBS. such that the average gain in normal curve equivalents (NOEs) will be at least 6.0 as documented 
by scores f.oWtall and spring testing, submitted to the program evaluator at the end of the instructional 
year. 

■Obieclive III 

At the end of the instructional yea, lab students, grade 1. who have been enrolled in the program 
for at least 80 days will demonstrate a proficiency on the mathematics composite score of the ,TBS. such 
^'^^^^^'-^^^^Semir.^^^^^^ 

submitted to the program evaluator at the end of th- instructional year. 

Table , M.1 and M.2 present data necessary to evaluate objectives III Al-3. Narrative pertaining to 
-Ihese objectives follow the tables. 

^-\- Total Mathematics Score Iowa-Tests of Basic-Skills- 
Grades 1-5 (Percentile Rank) 





N 


1 


292 


2 


237 


3 


267 




163 


5 


198 



16 24 
„1,9 20- 



+8 



23 25 
23 27 



29 32 

; er|c i9i 



+1 

+2 
+4 

+3. 



4 



1 

2 
3 
4 
5 



92 
237 
267 
163 
198 



Table M.2. Total Walhema'.U Score Iowa Tests of Basic Skills 
Grades 1-5 (Normal Curve Equivalents) 
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29.1 
31.2 
34,3 
34.2 
38.4 



34.8 
32.4 
35.6 
.37.1 
39.9 



+5.7 
+1.2 
+1.3 
+2.9 
+1.5 



2-5 
1 



865 
292 



34.4 
29.1" 



36.0 
34.8 



+1 

+5.7 



B£su!ls 

Ac«,ding ,0 Table M-l. s,u* a, all grade levels showed an increase in ,he percentile rank Irom 
pre (0 post te';«ing on the jo 
1. 



f Basic Skills. The largest increase occurred for students in grade 



Table M.2 reports the pre and post Normal Curve Equivalent scores for each of grades 2-5 and a 
weighted average. The Normal Curve Equ.alent (NCE, scale is similar to Ihe percentile scale- except 
that itJs an equal interval scale, meaning that'the distances between units have been equalised. This 
allows for averaging of scores which is not feasibly wi.h perceNiie ranks. A weighted average gain was 
computed due to the difference in numbers of students a, the various grade levels. The weighted 
average gain for students in grades 2-5 was 1 .6 NCE units ^^j^UcJLbelow.th.oslablished criterion-pf^ 



€.0. 



Objective ill A3 applies specifically to students in grade 1. Students 
5.7 NCC units compared to a criterion of 3.0. 



at this level achieved a gain of 
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■Objective IV f 
BySeplember 18. 1987. lab teachers will have selected students, grades 1-5 as documented t>y 
lists Of students (by grade level) who were selected for instruction and the rank order checklist, 
submitted to the program coordinator with September accountability data. 

Evatualion fJi^ \hrsr] 

The Des Moines Plan was no. officially implemented until January of 1988 following the initial 
administration of checkpoints. However, as staff was hired at the beginning of 1987-88. students were 
selected for instruction based on criteria established for identification by the Chapter I Programs. These 
criteria were established with the idea of being able to rank order students starting with those "in 
greatest need" of assistance. Students were then selected in rank order until classes were filled. 
Teachers completed a Des Moines Plan Pupil Enrollment Form for each student as he/she was selected 
( ^ for the program. The information on this form was entered on-line to what had been referred to as the 
-Chapter I database." now expanded to accept student records from all buildings. 

Rdsulls 

An initial set of class lists were produced from the database on November 17. 1987. Table M-3 
Shows the number of students that were originally identified at each center by grade level for the 
Reading/Writing Labs. 



ERIC 



193 



Table M 



Building 



■3 . Number of Students Served Des Moines Plan Mathematics Labs 

Number of Students Served By Grade Level 
^234- 
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(Elerrfeniary) 

Tola! 



Adams 

All Saints 

Brooks 

Cattell 

Oougias 

Edmunds 

Findley 

Garton 

Granger 

Greenwood 

Hanawalt 

Hniis 

Holy Fam 2 

Howe 

Hubbeil 

Jackson 

Jefferson 

King 

Longfellow 

Lucas 

Mann 

McKee 

McKinley 

Mitchell 

Monroe 

Moore 
. Moulton 

Oak Park 

Park Avenue 

Perkins 

Phillips 
Pleasant Hill 
Rice 

St. Anthony 

Stowe 

Studebaker 

Wallace 

Watrous 

Willard 

Windsor 

Woodlawn 

Wright 

TOTAL 



07 

06 

OH 

12 

10 

19 

16 

09 

15 

08 

06 

04 

00 

12 

04 

13 

06 

21 

13 

18 

09 

10 

12 

02 

00 

08 

30 

09 

10 

00 

09 

04 

10 . 

00 

18 

04 

10 

06 

23 

03 

09 

10 

403 



11 

03 

16 

06 

02 

12 

09 

02 

10 

10 

03 

15 

00 

07 

02 

06 

.05 

33 
12 
13 

03 

06 

10 

04 

00 

08 

20 

13 

12 

00 

05 

00 

13 

01 

20 

04 

12 
02 

12 
03 
12 
02 
339 



11 
00 
17 
06 
02 
14 
06 
OG 
10 
05 
04 
12 
05 
09 
03 
10. 
05 
00 
19 
16 
05 
1.1 
06 
08 
20 
06 
06 
12 
20 
15 
07 
03 
00 
00 
10 
03 
10 
09 
17 
02 
07 
07 
344 



10 

01 

08 

09 

00 

10 

02 

05 

03 

05 

05 

04 

00 

08 

01 

08 

05 

00 

14 

10 

02 

06 

08 

04 

13 

06 

04 

06 

7 

15 

05 

01 

00 

01 

10 

00 

06 

08 

09 

03 

05 

01 

228 



06 

01 

16 

08 

01 

17 

10 

03 

07 

06 

05 

09 

00 

04 

01 

07 

01 

00 

05 

11 

02 

10 

08 

03 
14 

04 

06 

04 

12 

14 

00 

07 

00 

CO 

09 

00 

04 

08 

07 

03 

05 
04 
242 



45 

11 

65 

41 

15 

72 

43 

25 

45 

34 

•23 

44 

05 

40 

11 

44 

22 

54 

63 

68 

21 

43 

44 

21 

47 

32 

66 

44 

61 

44 

26 

15 

23 

02 

67 

11 

42 

33 

68 

14 

38 

24 

1556 
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As be seen I,om Table M.3 , .556 studems we,e rn«y rdeniified lor pa*rpa,ion 
Oes Moines Plan Malhemalics lab classes a, ,no elemenla^ level. A lull lime leacher, aocord^g ,o ,be 
fKogram proposal, could serve between 45 and 55 sludenls. 

Ellods are ounrenlly being made ,o develop a revised Des Moines Plan enrollmeni documen, ,hal 
« reduce ,he a„x,un, ol dala enlry mat is ourrenil, perlormed by Des Moines Plan clertcal slafl. This 
step shou« allow lor generation ol initial class lists in a much more timely lashion. This obiecive was 
achieved as the actual process ol studen, seteclton was compleled by the specilied date. 

Obiedivp IV pf> 

During t,e Instructional yea, lab teachers .illoevelop an, maintain an lEP for eac, student 
receiving lab instruction as documented by lEPs on file with the lab teachers. 

. Evaluation f/ ftibn^j 

Des Moines Plan consullanis examined Individual Educational Plans during visHs to program sites 
A. »,e end ol the lirs, semester, ihe consullant iniliated a lorm entiiled -Des Moines Plan Educational 
«an Summary Sheer which indicated thai each lEP had been examined and was properly writlen. 

ResjjJia 

■ndividua, Educational Plans were dovetoped and maintained lor each Des Moines Plan student 
The educalional plan includes a lisling ol objeaives ,o be introduced to each studen, and various ' 
■caching siralegies thai will be employed. One of the tuitions ol the Des Moines Plan consultants is ,o 
mon,or the recorr^ng ol inlormation lor ea.h sluden, on ihe educalional plan. The consullan, initials Ihe 
oducationalpian to indicate that the necessary inlormalion has been recorded as ol a pedicular dale a^ 
fhat Ihe plan has been implomoniod. 

Ounng mo ,ns,n.c,:ona, ye., ,oac^,s w,„ ,„s,ruc: .S-SS s,.** for ,5.30 n,nu,os as 
■^cun^n,c,ty sC,c<lulos. sv,„mo, ,o ,/« prooran, coor*.„o, by Seplcto «, ,os7. an, 
Icsulmtillod each lime a sclieclule change is made. 
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Evalijalinn Mp|hr>rf ' 
Lab teaching schedules were s.bmitled by all Des Moines Plan teachers as classes began in mid 
September. Revisions were submilled as necessary during the school year. 

Pesulis 

Lab teaching schedules were submilled by all Des Moines Plan teachers as classes began in 
September. Revisions were submitted as necessary. The schedules indicate the lab teaching times 
and number of students served in each group. Other information appearing on the schedule includes 
the time tha, direct instruction is provided by the classroom malhematics teacher and the time thai the 
lab teacher and classroom teacher engage in planning sessions. The schedules indicate tha. lab 
Classes n>et from .5-30 minutes and that a fulltime teacher served from 45-55 students as specified in 
the obiective. .ns.ruc.iona. group sizes ranged from 1 to 8 for lab classes according ,o the schedules. 
Much Of the information on the schedules is venfiod a. leas, once during .he year when the building 
principa. conduc.s the observations necessary .o complole .he Principals Report of Des Moines Plan 
Supervision (see objec.ive II Bl for a discussion of .his documen.). 

Qbiective IV 

By the end of the Hrsl semester, lal^ teacl^ers will have had personal conferences with the 
P'^^'^^^^Ouardlans Of at least 80 percent Of the total numt^^^ 

enrolled ;n the program for at least 20 days. These conferences will be conducted at the homes of, or at 
places selected by. the parentsfguardians as documented by attendancefparent contact reports 
'^^^^^^^i-'^'^-^^-ryaccountabilitydatatoth^ 
principals. 



with the 



^y^^'ond Of the second semester lab teachers will have had personal conferences win 
^^P^^'"'^^0u.irdi,nsofatfoast80pc.^^^^ 

enrolled in the program for at least 20 days during the second semester. These conferences will be 
conducted at the homes of the parents/guardians at school or by telephone as documented by 
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Bttendancefparent conlact reports, submiiled May accour^tability data to the prograrr^ ^ordinator, 
program evaluator and building principals. 

Table M-4 provides the data necessary to evaluate objectives IV B4 and IV B5. both of which 
concern contacts with parents of students in Des Moines Plan labs. 

Table M-4. Contacts with Parents Des Moines Plan Mathematics Lab Program 

Grades1-5 1987-88 

N Percent jotal n Percent T...r 

2182 



^^3^ . 2103 TazQ 



During the first semester, objective IV B4 specifies that lab teachers will have personal contact with 
the parents of 80 percent of the students enrolled for a period of 20 days or more. Personal contact 
implies a face ,o face contact between the parent and teacher through a home visrt by the teacher or a 
visit to school by the parent. Telephone calls or letters sent to the home do not count as personal 
contacts during the fall semester. During the first semester, parents of 84.4 percent of the mathematics 
lab students were contacted thereby surpassing the established criterion. Objective IV B5 also 
specifies that parents of 80 percent of the students enrolled 20 days or more would be contacted 
personally during the second semester, but allows telephone calls made to the home to be counted as 
personal contacts. During the second semester, according to Table M- 4. parenls of 84.4 percent of the 
mathematics lab students were contacted, thereby suo^assing the criterion of 80 percent by the same 
margin as during the firsi semesler. 

The-lable-also shWs"aT6tai-5R285 ^ctslaTl meM^ds7ounTed) m7deTun-;ig'thT^;i^ 
parents of lab students. This would seem to represent a continuation of the long existing trend in the 
districl-s Chapter I Programs of maintaining a high level of coolnct wiih parents of lab stt,do„ts. 
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Objective IV RQ « 
By October 2, 1987. lab teachers at each building have submitted the r^ame ofaparer^t to be a 
represer^tative or. the District Parer^t Advisory Cour^cilas docurr.er.ted by parer^t r,ar.es submitted to 
The Des Moines Plan Supervisor. ' 

A fel Of ,ep,osen,alives ,o ,he Chapler .Des Moines Plan Disl-icI Pa-enl Adviso^^ Counc» was 
received by ,ne Depadmen, of Evaiuaiion, Research and Tesiing on March ,0. 1988. The lis, ilsel, was 
no. daled, making « imposs«>le lo dolen„ine when H was developed The fel conlained names, 
addresses and lelephone numbers of 59 building represenlalives and 3 communily represenlalives. I, 
Shouldbe noled .ha, „h»e some buildings had a number o( represenlalives lisled, a lolal o( len 
elemen,a,y buildings were no, represenled. In as much as Ihe inleni of .his process objedve was .o 
have represenlalion on .he counc» from each cenle, involved wilh The Des Moines Plan, ihis objeCe 



was nol achieved 



Obi'edfve Vi /\t 

«ea,»e enrf o,,.e ,««,™a,yea, apare«s„,vey .»te co,W.c,e,.ty 
-evaluator, 

£yal u^Qn melhoj 

During .he ,987-88 school year, .he paren, survey ,ha, had been used for a number of years in ,he 
Chapfer .Program was comp,e,ely revised. This was done in response ,o a recomn,enda,ion made in 
,he ,986.87 ftepod 0, Sva,ua,ion for Chapier I Reading and Ma,hema,tes Programs. This 
reconunendalion-suggesied l„a, a more comprehensive quesiionnaire be designed ,ha, would 
hopefully no, only be a be„er insln^nl f or galhering informaifen from parenfs abou„h ei, ^rcepiions 
0, Ihe new Des Moines Plan, bul would also yield a bo„cr ra,e of refum ,han had been experienced in 
^Re>pasl. 

The seven i,em revised inolmmeni. a copy of which appears in Appendix R/W. M- B was sent to a 10 
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percent random sample of parents of all Des Moines Plan lab students on April 15. 1988. Th'ree 
hundred eighty five questionnaires were sent out via U.S. mail. 61 or 15.8 percent of which were 
returned. While this represents a slightly better rate of return than had been experienced in previous 
years. H is nonetheless insufficient for making generalizations to the population of Des Moines Plan 
parents. Results of the survey are summarized in the statements below with the qualification that 
generalizations cannot be made from the responses of this sample to the population at large. 

Resu!t<} 

- Forty five of the 61 respondents (73.8%) agreed or strongly agreed that they were 
satisfied with information they had received about the Des Moines Plan. 

- The process for selecting students for participation in this program satisfied 36 (61 .1 %) of the 
59 parents responding to this question. Thirteen (22.0%) were not satisfied to some degree. 

- Of the various ways in which parents are contacted by Des Moines Plan lab teachers. 64.0 
percent of the respondents preferred scheduled conferences at school with The Des Moines Han 
teacher. Only 2 (4.0%) indicated preference for home visits by the teacher while 9 (18.0%) preferred 
telephone calls. 

- Thirtyone respondents (67.4%) fell that letters provided the best avenue for obtaining 
infomialion about the District Parent Advisory Council and its activities. 

- Over one half (56.3%) of the respondents folt that brochures and information about learning 
activities for use at home would be the most useful items that could be provided through the Parent 
Advisory Council. 

Although the return rate improved slightly from that in previous years (using Chapter I surveys), the 
r^umbor of returns via U.S. mail was still far from that necessary to allow for generalizations to be made 
Irom .he sample to the population. This is unfortunate as costs are involved in designing, printing and 
^mailing such an instrument. Given this situation, it would seem feasible to consider giving parents an 
mpporlunily ,o complete this survey during conference time as many participate in this activity. This 
^vouId increase the response rate-and could be set up in a way that would still ensure anonymity of 
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t 



respondents. 

PROCESS AND PERFORMANCE OBJECTIVES 
Middle School Mathematics Lab Program 
Obiedlve II R-| 

The program coordinator morganlze ar^dmamir^ ar^ accour^tamym ar^d provide copies of data 
to support the evaluattor^ of all objectives as documented by accountability files maintained by the 
program coordinator and the Department of Evaluation. Research and Testing. 

Results ■ 

Duplicate accoulabilily files were maintained in the Des Moines Plan Office and the Department of 
Evaluation. Research and Testing during the 1987-88 school year. Periodic checks were conducted 
<}uring the school year to assure that data to evaluate program objectives were being collected. The 
data were submitted to the Department of Evaluation. Research and Testing at the end of the program 



year. 



i2bj£cliveJllAl 

At the end of the Instructional year, lab students, grades 6-8 ^ho have been enrolled in the program 
for atieast W-day's will demonstrate an increase In the mean percentile rank from pre to post test on the 
- n^athematlcs composite score of the Iowa Tests of Basic Skills (ITBS) as documented by scores from fall 
and spring testing submitted to the program coordinator at the end of the Instructional yea, 

Qt2ieclivcJlLA2 

At the end of the Instructional yea, lab students, grades 6-8 who have been enrolled In the program 
tor at least 80 days.wlll demonstrate a proficiency on the mathematics composite score of the ITBS. such 
that the average gain In normal curve equivalents (NCEs) wilt bo at least 3.0 as documented by scores 
from fall and spring testing, submitted to the program evaluator at the end of the Instructional yea, 

ElISLlJlS 

^Tables M-5 and f^-G pro.oni results for students in grades 6-8 on the mnlhematics composite subtest of 
the Iowa Tests of f3asic Skills. 
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Grade 


U 


ElS. 


6 


115 


25 


7 


97 


24 


8 


79 


22 



6-8 



291 



Table M.5. Total Mathematics Score Iowa Tests of Basic Skills 
Grades 6-8 (Percentile Rank) 

32 
27 



25 



Qaia 
+7 

+3 
+3 



Table M-6. Total Mathematics Score Iowa Tests of Basic Skills 
Grades 6-8 (Normal Curve Equivalent) 



£rads 


N 


£££ 


JEfiSl 


Qm 


6 


115 


35.8 


40.0 


+4.2 


7 


97 


34.9 


37.0 


+2.1 


8 


79 


33.8 


35.9 


+2.1 



35.0 



37.9 



+2.9 



According to Table M-5. students demonstrated an increase in percentile rank at each grade level as 
specified in Objective .,1 A1. The weighted gain in the average Normal Curve Equivalent (NCE) score as 
shown In Table M-6 was 2.9 NCE units. This is only 0.1 NCE units below the criterion expressed in 
objective III A2. 

QWeclLviLliLAa 

By the ondofho inslrucUonal year, lab students, grades 6-8, who have been enrolled in the 
P^^^^'-^or at leas, 80 days. ill display a. ore positive attitude toward 1^^^^^^^^^ 
lime Of their entrance into the program as documented by the Pre and Post Attitude Toward Learning 
0ummary, submitted to the program evaluator at the end of the instructional year. 
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Evaliialinn Mftthffti ' 
Des Moines Plan students at the middle school level completed a pre/post self evaluation 
Instrument designed to measure attitude toward various academic activities. 

BfiSuJls 

Several problems arose in the administration of this instrument during the 1987-88 school year. 
One of those involved the fact that it was not possible to determine whether the rating scales received 
were administered as part of a reading/writing or mathematics lab class. Some of the students may have 
participated in both programs while others were in one program or the other. 

Because of this situation, tabled resutts. narrative and recommendations have been placed under 
Objective 111 A3 in the middle school reading^vriting section of this report. If the Des Moines Plan 
proposal continues to list sepa;ate performance objectives for readin^riting and mathematics students 
involving attitude measure, it wih be necessary to submit the documents in such a fashion that allows for 
a separate tabulation of the results. 

During the inslructiona, yea, lab studonis. grades 6-8. ^ho have been enrolled in the program for a, 
least 80 days ^il, respond positively to the program, as indicated by their rate of attendance being equal 
_ to or greater than that of all lab students in the same schools as documented by attendance/parent 
contact reports submitted with May accountability data to the program evaluator and program 
coordinator. ' 

Objective III A4 states th.t the attendance of Des Moines Plan tab students enrolled in tt,e program 
for 80 days will display a rate of attendance that is equal to or better than that of nonprogram students in 
the same schools. Emphasis on the importance of school attendance has been a priority in the Chapter t 
Program since its inception and continues to be considered as such in The Des Moines Plan. 
0 Table M.7 displays the attendance rate (indicated by days attended as a percentage of days 
possible for attendance) for Des Moines Plan and non Des Moines Plan students at all schools. 
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Table M-7. Attendance Rale Des Moines Plan/Non Des Moines Plan 
Middle School Students 1987-88 



Buildino 


Des Mnipi^f^ 
£i 


Plan 

Percent 


NcnrDes.MQiQesJPlan 
^ Eercem 


Brody 


o\j 


94.6 


609 


91.7 


Calianan 


39 


92.2 


587 


93.7 


Goodrell 




88.4 


732 


92.5 


Harding 


122 


07.0 


674 


92.8 


Hiatt 


63 


90.7 


483 


91.3 


Hoyl 


54 


89.1 


493 


92.8 


McCombs 


22 


83.9 


579 


93.2 


Meredith 


36 


89.9 


621 


94.6 


Merrill 


34 


93.7 


501 


94.6 


Weeks 


51 


91.5 


621 


93.1 


All Buildings 


443 


89.8 


5900 ' 


93.1 ~ 



As Wicalod by Table M.7, ,he auondanco ra,o .or Dos Moines Plan n,a,hon,a,ics s,udon,s a, me 
mwie school level was 89.8 percen, compared ,o 93.1 percen, lor non-lab s.udenls. A, Brody Middle 
School. Des Moinos Plan sludonis displayed an allendanco rale higher lhan ,ha, ,or non-lab oludenis 
AS ,he overall allandance rale lor Des Moines Plan sludenis was lower, ,l„s obieclve was no, achieved. 

DiJieclivejvai 

m tetow ,n oacUbum:no servotf w,™ ,w„;«,y, e/«,» s<.*n,par,;*a,«6,. 
Sep,e„to ,8. ,087. as ,ocu,.on,o, ty c,.ss «s (.yoraOo ,c,o,) o„;,nmo, s,u,.n,s a-«,/,e 
o%«% cocm,. subn,i„cO ,0 me coor*a,or ,vjfi Sep,e,*er accow„t.% tfate. 

IJyaluvilionjwiC'ihftcl 

The Des Moines P/an was not implemented until Januno' of 1988 following the first ndministrntion of 
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Checkpoints. However, as staff was hired at the beginning of 1987-88. students wore tentatively 
Wentified and servc-d beginning in September by the date specified in this objective. An initial set of 
class lists was produced from the database on November 17. 1987. Table M- 8 shows the number of 
students that -^ere originally ldenlifi;d at each attendance center by grade level for the mat:,emalics 



labs. 



Table M-S. Numer of Middle School Studenis Served Des Moines Plan 
Mathematics Labs as of November 17, 1987 



Building 



Number of Students Served By Grade Level 
6 7 8 



Total 



Brody 

Callanan 

Goodrell 

Harding 

Hialt 

Hoyt 

McCombs 
Meredith 
Merrill 
Weeks 



TOTAL 



6 


11 


8 


9 


9 


6 


8 


8 


10 


45 


44 


29 


24 


•20 


18 


14 


10 


14 


8 


10 


7 


12 


11 


8 


10 


5 


8 


20 


21 


14 


156 


149 


122 



25 
24 
26 
118 
62 
38 
25 
31 
23 
55 



427 



. As can be seen by Table M- 8. 427 students were initially identified for participation in Des Moines 
Plan mathematics lab classes at the middle school level. Ffforts are currently being made to develop a 
revised Des Moines Pian enrollment document that will r.duce the amount of data ent^- performed by 
Ihe Des Moines Plan clerical staff. This step should allow for generation of initial dass tisis in a much 
more timely fashion. This objective was achieved, as the actual process of student s^T'ection was 
completed by the specified date. 

Qt>jC£livi?iVJ12 

Lab teachers will develop and maintain an Individual Hducatlonal Plan (inP) lor each participating 
' student as documented by tHPs on file with tl)e lab teacliers. 
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Evaluation Method ' 
Des Moines Plan consultants examined Individual Educational Plans during visits to program sites. 
At the en^ of the first semester, the consultant initialed a form entitled "Des Moines Plan Educational 
Plan Summao. Sheet" which indicated that each lEP had been examined and was properly written. 

Individual Educational Plans were developed and maintained for each Des Moines Plan student. 
Tie educational plan includes a listing of objective, to be introduced to each student and various 
teaching strategies that will be employed. One of the functions of the Des Moines Plan consultants is to 
monitor the recording of information for each student on the educational plan. The consultant initials the 
educational ptan ,o indicate that the necessa-y information has been recorded as of a particular date and 
that the plan has been implemented. 

Obieclivfi IV F? 3 

Lab teachers win instruct 55-75 students. Students will receive instruction for an average of 45 
minutes daily as documented l^y mathematics schedules, sul^mitted to the program coordinator t^y 
September 18. 1987. and resubmitted each time a schedule change is made. 

Evaluation M(?j hpf} 



Lab teaching schedules were submitted by all Des Moines Plan teachers as classes began in mid 
September. Revisions were submitted as necessary. These documents were forwarded to the 
Department of Evaluation, Research and Testing at the end of the school year. 

PesuJis 

The schedules indicate the lab teaching schedule and number of students served in each group. 
Other information appearing on the schedule includes the time that the lab teacher and various 
Classroom teachers plan jointly. Lab classes at the middle school level met for one class period or 
approximately .5 minutes daily. Instructional groups ranged in si.e from 5 to 15 students. A fulllime 
teacher could serve up to 75 students. 
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Obiectivp IV R4 r 
By the end of the instajctional year, lab teachers will have had personal contact and^or conferences 
Mh theparentsfouardlans of at least 50 percent of the total number of students, grades 6-8. who have 
teen enrolled !n the program for at least 20 days as documented by Attendance/Parent Contact 

''''^'''•'-^'^^^^^0 the program coordinator, program evaluator and buMng 
the instructional year. 

BesuIJi 

Obioc,i>,e ,v slales ,ha, parenis of a, loas, 50 percen, of ,f,e sludenis enrolled in ,he Ma,l,ema«cs 
Lab Program for 20 or more days wo„ld be conlacled personally al some lime during ,he school year. 
■n« crilerfa eslablished lor parenl conlacl al this level were less siringen, fhan al ,he elemenlary level 
w*h speoiW oonlact wiih parents during each semester. -Personal conlacl- is defined as a visil by 
^ ^ the .eacher ,6 IheMme of a swenl.a vish by fhe paren, ,o school or a felephone call made by fhe 
teacher to :h= parent. Documentation submitted revealed that personal contacts were made to the 
parents of 67.0 percent of the students enrolled 20 daysor more thereby exceeding the specified 
cnlerion. A considerable range wa., noted among middle school attendance centers in the number of 
parent contacts made. At lour centers, Callanan, Goodrell, Meredith and Metro, parents of less than 50 
: percent of the number of students served were contacted, while a, Merrill Midole School, parents of all 
students were contacted during the school year. 

Obio clivB IV K!i 

fte e,Kf o/,/,e ;««,,bna/y.ar, /afiteactos ™7//,ave con,pte,e^ 
as *c™n,«, ,y Paren, AcMy P,.nnlno S,ec,s s.bnmo<, ,o program coor*afor a, ,„c en, o, 
the instructional year. 

Lab teachers submilied a documcni cniiilcd Paren, Acliviiy Planning Sheet lhal contained 
#rormalion aboul aclivilies provided for parenis of sluden.s in .he lab progran. Generally, ihe aclivi.ies 
involved inviting parents to visit the labs ai a specified lime at which they could see and participate in 
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various acUvilies. fn several cases, the use of computer workslalions was demonslraled ar>a parents 
were then encouraged to participate in a computer activity. In many cases, the activities were provided at 
eilherconference or open house time. Activity sheets indicating the occurrence of at least one parent 
activity were received from all middle schools with the exception of Hiatt. Except for this noted 
deficiency. Objective IV B5 was achieved 

Obiedivff VI A-f 

<^<^^'^^'^ted by a summary 0! responses Obtained from a parent survey con^^^^ 
evaluaton 

Evaluation m^jh^^j 

During the 1987-88 school" year, the parent survey that had been used for a number of years In the 
Chapterl Program was completely revised. This was ctene in response to a recommendation made in 
the 1986.87 Report of Evaluation for Chapter I Reading and Mathematics Programs. This 
recommendation suggested that a more comprehensive questionnaire be designed that would 
- -hopefully not only be a belter instrument for gathering information from parents about their perceptions 
of the new Des Moines Plan, but would also yield a better rate of return than had been experienced in 
the past. 

The seven item revised instrument, a copy of which appears in Appendix R/W. M -B was sent to a 1 0 
percent random sample of parents of all Des Moines Plan lab students on April 15. 1988. Three 
hundred eighty five questionnaires were sent out via U.S. mail. 61 or 15.8 percent of which were 
relurned. While this represents a slightly better rate of return than had been experienced in previous 
years, it is nonetheless insufficient for making generalisations to the population of Des Moines Plan 
parents. Results of the survey are summarised in the statements below with the qualification that 
generalizations cannot be made from the responses of Ihis sample to the population al large. 

- Forty five of the 61 respondents (73.8%) agreed or strongly agreer' that they were 
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satisfied with information they had received about the Des Moines Plan. 

- The process for selecting students for participation in this program satisfied 36 (61.1%) of the 
59 parents responding to this question. Thirteen (22.0%) were not satisfied to some degree. 

- Of the various ways in which parents are contacted by Des Moines Plan l^b teachers. 64.0 
percent of the respondents preferred scheduled conferences at school with The Des Moines Plan 
teacher. Only 2 (4.0o/o) indicated preference for home visrts by the teacher while 9 (18.0%) preferred 
lelephone calls. 

- Thirty-one respondents (67.4%) felt that letters provided the best avenue for obtaining 
•nfomialion about the District Parent Advisory Council and its activities. 

- Over one half (56.3%) of the respondents felt that brochures and information about learning 
activities for use at home would be the most useful items thai could be provided through the Parent 
Advisory Council. 

Although the retum rate improved s'ightly from that in previous years (using Chapter I surveys), the 
number of returns via U.S. mail was still farfrom that necessao' to allow for generalizations to be made 
Irom the sample to the population. This is unfortunate as costs are involved in designing, printing and 
mailing such an instrument. Given this situation, it would seem feasible to consider giving parents an 
opportunity ,0 complete this survey during conference time as many participate in this activity. This 
v,ould increase the response rate and could be set up in a way that would still ensure anonymity of 
respondents. 

PROCESS AND PERFORMANCE OBJECTIVES 
, ' Scnfo.'- High Mathematics Lab Program 

QbiecLivgJJLai 

During the inslrucHonal yea, me coordinator ^ill organize and maintain an accountabiility file and 
provide copies of data to support the evaluation of all objectives as documented t^y accountability files 
by tlio program coordinator and the Department of Evaluation. Researclu^^^ 
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Pesu'is * 
Ouplfcate accountability files were maintained in ,t.e Des Moines Plan office and tt.e Department of 
Evaluation. Research and Testing daring the 1987-88 school year. Periodic checks were conducted 
during ,he school yearto assure that data to evaluate program objectives were being collected. The 
data were submitted to the Department of Evaluation and Research at the end of the program year. 

ObiectivP |||/\i 

At the end of the InstrvcUonal year, tab students, grades 9-12. ^ho have been enrolled In the 
program for at least 80 days .^1 demonstrate an increase in the mean percentile rank from pre to post 
test on the quantitative thinking subtest of the lo^a Tests of Educational Development as documented 

^y'<^^^^^^ornfanandspnngtesting.submittedtotheprogramevaluator 
year. 

Obiectivp lif Ag 

At the endoflhe instructional year, lab students, grades 9-12, ^ho have been enrolled in the 
P^°3ran.^oratleast80days.illdemonstrateaproficiencyontheq^^^^^^^^^ 

JTEO, such that the average gain in nor mal curve equ i valents (NCEs) will be at least 3.0 as docum ented 
year. 

Tables M.9 and M-10 report data on the quantitative (mathematics) subtest of the Iowa Tests of 
Educational Development. 
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Table M-9. Quantitative Thinking Iowa Tests of Educational Development 
Grades 9-12 (Percentile Rank) 

" ■■ ^ M m 

' " 13 

10 2 CO 

^2 20 .12 

11 No students served during 1987-88 

12 No students served during 1987-88 
Students in grade 9 showed an increase in percentile rank from 11 to 13. In grade 10. pre/post 

results wer, available lor only 2 students (there were only 3 sluderrts at this level in the program). While 
a decrease in the percentile rank was observed, no further statements can be reasonably made due lo 
the number of students in grade 10 involved in this measuremf;nt. 

Table M-10. Quantitative Thinking Iowa Tests of Educational Develoment 
Grades 9-12 (Normal Curve Equivalent) 

^ £asl Gain 

^ 23.9 -26:5"- 

- 2 40.0 

1 1 No students served, in 1987-88. 

12 No students served in 1987-88. 

Students in grade 9 demonstrated a gain of 2.6 NCE units on the quantitative thinking subtest. In 
grade 10. a negative gain of 7.7 was observed. The grade 10 results may not be generalized, however 
as only two students completed a pre and post test at this level. 

By the end of iho instrvcHonal yea, lab students, grades 9- 12. who have been enrolled in the 
^P^'^Oramrcr at least 80 days will display a n^re positive atti,^^^ 

lime of their entrance into the program as documented by the Pre/Post Attitude m.ard Learning 



-^2:6 

32.3 -7.7 
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Summary, submitted to the program evabator at the end of the instructional year. 

Evaliialinn Mothr.tf 

Des Moines Plan students afthe senior high level completed a pre/post sail evaluation instrument 
designed to measure attitude toward various academic activities. 

fiesuits 

Several problems arose in the administration of this instrument during the 1987-88 school year. 
One Of those involved the fact that it was not possible to determine whether the rating scales received 
were administered as part of a ReadingAVriting or Mathematics Lab class. Some of the students may 
have 

participated in both programs, while others look part in one or the other. 
^ _ Because of this situation, tabled ;esults. narrative and recommendations have been placed under 
Objective 111 A3 in the senior high reading^vriting section of this report. If the Des Moines Plan proposal 
continues to list separate performance objectives for reading and mathematics students involving 
attitude measure, it will be necessary to submit the documents in such a fashion that will^IIow for a 
-separatelabulation-ofthe-resOils: " 



By the end of the Instructional yea, lab students will respond positively to the program, as 
indicated by a rale of attendance higher than the district average as documented by AttendancefParent 
Contact Reports, submitted with May acccuntabinty data to the program coordinator and program ^- 
evaJuaton 

Table m 1 shows the allondance rale (days prosoni as a percentage of days possible for 
altendance) for Dos Moines Plan students at each senior high building and for the total senior high 
lalhematics lab program. Also indicated is the attendance rale for all students at each senior high 
building and for all buildings combined to yield a district attendance rale. 
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Buildinp 

East 

Hoover 

Lincoln 

North 



AnSchnnk 



.m. 



.ma. 



All StiJrifinff; 

U Emm 



Table M-11. Attendance Rate Des Moines Plan/Non Des Moines Plan 
Senior High School Students 1987-88 
Des Mnippf^ pifin 

24 91.1 
22 92.5 
40 86.2 
38 88.8 

89,9 



2291 
1219 



91.8 
94.4 



2524 92.5 
1052 91.6 



-1558 a^a 



AS sh»n ,y Table M-„, „e average anenda^e ,a,e ,o, a,, sentor hig. studems In ,he disWo, was 
92.5. This compared ,o an a«endance ra,e o, 89.3 ,o, students «, T.e Des Moines Plan ™,he.a%s 
.abs. As ,be specilicatton ,ba, Des Moines Plan s,uden,s would ,«sp,a, a ra,e o, a«enda™e higbe, ^ 
the dBlricI average was not met. this obiecli.e was nol_achJeved. 

A process objeotive in7he middle school malhematics lab ^ogram states that the attendance rate 
0. Des Moines Plan students will be compared to that o« non-lab students in the same buMings The 
sen»r high objective on the other hand does not specit, the con^arison g„up as being ™de up o< 
only non-lab students, but instead uses the distrfct average senior Ngh attendar^e rate whteh is 
computed using the attendance records o, all students including those in the program. Por pulses o, 
consistency and in order to better detine the two groups, this obiective should be reused to call tor 
companson ot attendance rates between Des Moines Plan a™t non Des Moines Plan students. 

Qbieciive iV p t 

BySepten^er ,S. ,m7. ;aW.ac/,.„ sel^„„^, ,ra,ess.12as ,ocun,o.,e, ,y 

<,/s,.*„« Ibyg,^, sele^eC for insln^lon an, me rank or^arcMlls, 
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submitted to the program coordinator with September accountability data. ' 

Evaluation Mf^^h^^ 

The Des Moines Plan was not implemented until January of 1988 following the first administration 
of checkpoints. However, as staff was hired at the beginning of 1987-88. students were tentatively 
identified and served beginning in September by the date specified in this objective. An initial set of 
class fists was produced from the database on November 17. 1987. 

Results 

Table M-12 shows the number of students that were originally identified at each attendance center 
by grade tevel for the mathematics labs. 



Table f^-12. Number of Students Served Des Moines Plan Mathematics Labs (Senior High) 

(As of November 17. 1987) 



Number of Students Served By Grade Level 



Building 


a 


IQ. 


11 


IZ 


iQial 


East 


26 


0 


0 




26 


Hodvef 


15 


0 


0 


0 


15 


. Lincoln 


26 


1 


0 


.0 


27 


North 


34 


0 


0 


0 


34 


Roosevelt 


9 , 


0 


0 


0 


9 


TOTAL 


110 


3 


0 


0 


113 



As can be seen from Table M-i2. 113 students were initially identified for participation in 
Des Moines Plan mathematics lab classes at the senior high level. Efforts are currently being made to 
develop a revised Des Moines Plan enrollment document that will reduce the amouni of data entry 
performed by The Des Moines Plan clerical staff. This step should allow for generation of initial class lists 
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in a much more timely fashion. This ob)ective was achieved as the actual process of student selection 
was completed by the specified date. 

Obj ective IV B2 

During the instructional year, lab teachers will develop and maintain group charts for students 
receiving lab instruction as documented by group chads on file with the lab teachers. 

Group charts were maintained by each teacher seiving senior high students in the mathematics lab 
program. The group charts served much the same purpose as the Individual Educational Plan (lEP) 
which Js developed for students at the elementary and middle school level. The charts are used as a 
recordkeeping device to monitor the progress of students in the attainment of objectives that are a part 
Of their individual program. Des Moines Plan consuliants- monitored the existence of the group charts at 
the time of regular visits to the buildings. 

Obiectlvt^ IV 

During the instructional year, lab teachers will instruct 55-75 students daily as documented by lab 
schedules, submitted to the program coordinator by September 18.. 1987. and resubmitted each-time a- 
schedule change is made. 

Result {j 

Lab schedules were submitted by each senior high teacher during the month of September. 
Revisions were made thoughout the year as needed. The schedule indicated the lab teaching 
schedule and the number of students served in each group. 

■Q bioctive I V R4 

Every nine weeks, lab teachers will make personal contact with the parents/guardians of all 
students, grades: 9-12. who .have been enrolled in the program for at least 20 days as documented by 
Attendance/Parent Contact Reports, submitted with May accountability data to the program coordinator, 
program evaluator and building principals. 
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Obieclive .V B4 Slates .ha, teachers Will make persona, conlact wn^ 

students enrolled in the program for 20 days or .oreeve^nineweeKs. The attenda^e/parent.^^^^^ 
reports that lab teachers complete are submitted for each : 



however. Therefore, it is only possible to determine if 
which consists of two nine week periods. 



semester rather than each nine week period, 
such contact occurred during the entire semester 



Table M-13 provides information regarding contacts to 
senior high level. 



parents of mathematics lab students at the 



Table M-13. Contacts with Parents Mathematics Lab Program (Grades 9- 



12) 1987-83 



Number Enrolled 
20 Days 



123 



Percent 
Contacted 



50.4 



■Second v'^qmerTtftr 
Number Enrolled Percent 
20 Days Contacted 



127 



55.9 



Contacts were made with parents of 50.4 percent of the 



and 55.9 percent of those served during the second 



students served during the first semester 



semester. As indicated previously, it was not 



poss^le to determine whether or not this obiective was achieved. It should be noted that the number of 
contacts with parents of senior high mathematics students occupied a considerable range. At 
Roosoveh. Visually no contacts were reported during the entire year, while at North. 97.6 percent of the 
parents were contacted during the first semester and 100 



percent were contacted during the second 



semester. 
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gbiectivft vul 
Near the end of the instructional vear a n^r^n, . 

evaluator. . ^ ® ^''^ P^05«/n 

Evaluation Mfffh^ ^ 
During the 1987-88 school year, the parent survey that h.H h 

-he 1986.87 Report or e™, ,■ . '*"""'^='»"=^'°^"'"">™ndaUonmadein 

< on^, be a betler ,„s,™en, tor garnering ,„,orma,io„ „om parems abou, ,h», 

°''^"^"°^-°'--.'-'---y.«abe.e„a,eo.e.,„lI r 

Ihe past. ^^"^ '^^^'^ experienced in 



was sent to a 10 
hree 
were 
previous 



Jsee„...v,se.,-„s,™e„,.ac„p,,„,,,,^,^,„ 

-..an.n,.a.p,eo,pa,an,soU,,Oe.Mo,-„e.P,a„,abs,.e„,so„>>pri,,s.e8^^^^^^ 
'>und,ede,g«„.e,„e*„„a,.s„e.se„,ou,v,-aU.S .a» e.oMSa 

--.w.-,e.3.p.se„.as.b,..,,e„a,eo,Jb:^ "^^^^^^^^ 

r::::;:::::— ^^^^ 

Besiitlfi 

- Pori,,.eoMbeanospo„.e.s,.3.8%,ag.e.o,s,.„g,ag.o..aUbe,„o. 
-«,ea w„b ,.o™a,.„ ,bo, ,ad .ooelved abou, .0 DOS Mo,-„os P,a„ 

-Pon.,ng ,o ,b,s ^os„o„. TbMaen „e. no, sa«.. ,o ao.e deg.e 

-.onbo,espo.en.p.,e.ascbe.,eaoo„,e..osa,acboo,w.THeOoaMo,„^^ 
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teacher. Only 2 (4.0%) indicated preference for home visits by the teacher while 9 (18.0%) preferred 
telephone calls. 

• Thlrty-one respondents (67.4%) felt that letters provided the best avenue for obtaining 
Information about the District Parent Advisory Council and its activities. 

- Over one half (56.3%) of the respondents felt that brochures and information about learning 
activities for use at home would be the most useful items that could be provided through the Parent 
Advisory Councif. 

Although the return rate improved slightly from that in previous years (using Chapter I surveys), the 
number of returns via U.S. mail was still far from that necessao^ to allow for generalizations to be made 
from the sample to the population. This is unfortunate as costs are involved in designing, printing and 
mailing such an Instrument. Given this situation, it would seem feasible to consider giving parents an 
opportunity to complete this survey during conference time as many participate in this activity. This 
would increase the response rate and could be set up in a way that would still ensure anonymity of 
respondents. 

CONCLUSIONS 

Results Of the evaluation of performance and process objectives suggest that student attendance 
and communication with parents are two areas that received strong emphasis in this program. In the 
mathematics program, parents of 84 percent of the elementary students and 67 percent of the middle 
school students were contacted by telephone or in person during the year. 

The rate of attendance for mathemalics program students was 39.8 percent of the days possible for 
middle school attendees and 89.3 percent for senior high. . While crilerion levels established by the 
proposal were not reached, these rates of attendance closely approximate those for nonprogram 
students at the middle and senior high levels - 93.1 and 92.5 percent respectively. 

Student performance objectives involved administration of the Iowa Tests of Basic Skills and Iowa 
Tests of Educational Development on a pre/post basis as a measure of growth. Criteria for achievement 
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Included the amount of gain In the normal curve equivalent score. On the mathematics composite 
subtest, established criteria were exceeded when weighted averages were computed for grade i only. 
Two condrtions that may have adversely affected achievement gain during 1987-88 were: 
The Des Moines Plan Lab programs were modeled after the district's Chapter I and II 
Programs: however, one third of the buildings Involved in the lab programs had not participated in the 
Chapter Programs. Although Inservice training was part of the implementation process, unfamiiiarity 
with the model and delivery system could have had an adverse effect on achievement: and 

(b) The Des Moines Plan did not officially begin until January of 1988 following initial 
administration of checkpoints. This resulted in a considerable shift In the student population at mid year 
as some studenSs were exited from the program and others wore entered. The end result was that 
pre/post scores were available and included in evaluation re..ults for students that may have received 
instructional benefits for a shorter block of time than what would be expected. This would be particularly 
true for students ai wade levels in which all pupils complete the Iowa Tests of Basic Skills or Iowa Tests 
of Educational Development in the fall. This condition bears mentioning though an asssumption Is that 
the effect of H on the overall results for the program is probably slight. 

CorxJition (a) should be alleviated with the passage of time. Steps will be taken during the 1988-89 
school year to eliminate tesi sc". on the outcome measure for students that have not been served for 
an established length of time. 

While there were at least tv/o Instances in which proper documentation to evaluate process and 
performance objectives was not submitted (noted in recommendations section), it appears from the 
evaluation that the Des Moines Plan Reading/Writing Program was implemenled as called for in the 
proposal. 

RECOMMENDATIONS 
1. The Supervisor of the Des Moines Plan should reassess the usefulness of the Principal's Report of 
Des Moines Plan Supervision in the operation of this program. If this type of report is deemed useful, 
steps should be taken to ensure the more timely and accurate completion of this form. 
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2. It is -recommended that the Des Moines Plan Supervisor take action to ensure that valid fesuHs may 
be obtained from administration of an attitude instrument to all individuals for whom it is intended. The 
value of a pre/post measure is severely compromised when difficuHy occurs in matching resuHs from the 
pre and pos! administrations. 

3. it is recommended that continued emphasis be applied to encourage the improvement of student 
attendance. It would also be feasible to revise the objective for the senior high program so thlt it Is 
consistent with the middle school objective in comparing attendance of program with nonprogram 
Students. 

4. It is recommended that alternative methods for obtaining the perceptions of parents about the 
program be considered. It might be feasible to have an opinionnaire or other appropriate instrument 
completed at conference time or at another school activity that tends to be wed attended by parents. 
Costs Of designing, printing and mailing an instrument to measure perceptions are not warranted unless 
Oan adequate rate of return is encountered. 

5. The development of the process for measuring student perfomiance using a locally developed 
Objectives based instrument rather than a norm referenced test should be continued. Several 

measuring growth using an instrument that is closely matched witT^iirdiitifet^^m^ ~" 

6. Consideration should be given to limiting the involvement of the Department of Evaluation. 
Research and Testing in Hs monitoring of certain ongoing activities that are well incorporated into this 
program. Examples would include existence of Individual Educational Plans and lab schedules which 
are monitored on a regular basis by The Des Moines Plan consultants. 
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School 
Date 



PRINCIPAL'S REPORT OF DES MOINES PLAN INSTRUCTION 

Classroom Teachers' and Lab 
Teacher's Instruction 



Principal's Signature 



Classroom Teacher 



Direct 
Instruction 
to Lab 
Visit ation .Students 



Date 



Time 



Yes 



2.21 



No 



JOINT 



PLANNING 



Yes 



No 



COMMENTS ; 



EKonitivo Olroctor, ElpmoAtary EducationT 



Olio oooM tn Mn<r»/.<? nt •» 



Appendix R/W, M - B 
fieadinnWfitino. MathPmat?r^f=' Lab Prnnrani Pf^rent Snrvpy 



Oeparlmeni of Evafuation and Research 
Des Moines Public Schools 
^ 1800 Grand Avenue 
Des Moines, fowa 50307-3882 



April 15. 1988 

Dear Parent: 



yelr As° oarf''^^ fh?c 'i.'rl^ evaluation of The Des Moines Plan each 
information when plan^ingTe%^S9^am?n"'2tu?e y.earl""'- "'^ 
May 2, 1988. »u'vey dna return ii in the postage pad envelope by 



Thank you for your cooperation. 



Sincerely yours, 

John F. Tompkins 
Program Evaiuator 




Atch 

Parent Survey, Des Moines Plan, 1987-1988 



PARENT SURVEY 
DES MOINES PLAN 
1987-1988 



Please indicate the exfern «n ii/h:,.k 

app'oprlate response" '° =3'" '"^ 'o'low slaiemeois circling 

L'Scs'mSp,:^"' • received aboul 

Stfongfy 

Disagree Disagree No opinlcn Agree fi^ee"'" 

^' pa.?Wpa"n"l'n°The*De\ Mo1nes'°P?an" '°' 
Strongly 

O'-sagree Disagree No opinion Agree 1'^''' 

3. Persona? contacts between the schoni anw k 
ponent of this ptoQtam whiL ^^^^ 

communication have you had with vn?! '°"°V/'r.g. types of 

teacher during the past'schoollear^^'fcJ^c" X "^^'"^ 

Home visit from The Des Moines Plan teacher 

—Scheduled school conference with The Des Moines Plan teacher 

Des Moines Plan sponsored ac.ivi.ies'meelings a, the school 

Telephone calls from The Des Moines Plan teacher 

Home visit from The Des Moines Plan teacher 

Scheduled school conference wi,h The Des Moines Plan teacher 

Des Moines Plan sponsored activitles-'meetings at the school 

-.-.Telephone calls from The Des Moines Plan teacher 
1 have no particular preference for a certain method. 

PUASH COMPUTE THE OUEST.ONS ON THE REVERSE S.OE 0. THIS SHEET. 



10 vofee conoerns o, make siggelltons abou, Se pro5,am " "" 

s?/L'.^ui!',resr?^,ea':rrc/:nV:xt° 

Telephone calls 



Letters 

Brochures 

Public meetings 

Other Please describe. 



6. What fs the best way for you to communicate with the 
advisory council? (Please check one method) 

By telephone 

Through a building representative 

By attending a council meeting 

By responding to a survey 

Other. Please describe. 



7. What kind of Information provided through The District 
Advisory Council would be most useful to you? S^-ease 
check one method) ^ ir.ease 

Information on how students are selected for the program 

Description of the program and how it operates 

Information pertaining to evaluation of the program 

information on teaming activities that can be done at home 

p^ITH^?' ac"v'"»'es related to The Des Moines 

Plan that occur during the school year. 

Btochutes/handbook 

Please feel free to' make any comments about the program below: 



?!;^^^^ RETURN THIS OUESTIONNAIRE IN THF Pn<5TArc ha 
PflOVIOro BY MAY 2. ,968. THANK Vo5 FOr'yoIr "aIs^sTanCE 



PAID HNVELOPE 
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SELF-EVALUATION 
(Secondary) 

School 



Date 



Directions : 
Rate yourself 1, 2 2 ^ ^ ^ 

• ^ 3, 4, or 5 on each of the ite.s below. 

Rating Scale: 

1 = Never 

2 = Seldom 

3 = Sometimes 

4 - Usually 

5 - Always 

My daily behavior includes: 

completing work on time 

handing in neat work 



1^ following directions 

participating in class 

■ listening to otheri 

. using class work time 

working without disturbing others 

My attitude in class is: 
— - helpful 



interested I 

V 

respectful 

I 

improving 

disruptive 

disinterested 

disrespectful ^ 
^ problem 
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Report of Evaluation: 
SUPPLEMENT TO DES MOINES PUN PROGRAM EVALUATIONS 

1987-88 



AprowQcl: 



Department of Evaluation. Research, and Testing 
Des Moines Independent Community School District 
1800 Grand Avenue 
Des Moines, Iowa 50307 



Diane Schnelker 
Evaluation Specialist 

John Tompkins 
Program Evaluator 




Morris D. Wilson. Ph.D. 
Director of Evaluation. Research, and Testing 



October 20, 1988 
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INTRODUCTION * 

The Des Moines Plan: A P.an.for.S.uden, Success represen.s an expansion and reorganization of 
a.. distn-C remedial programs. Modelled af.er the district's Chapter I and II Programs, the implementation 

Of all programs subsumedundertheOesMoines Plan is guided byaseriesofprocess and performance 
obiectives. While the obiectives facilitate the organization of the program, they do not necessarily ' 

provide sufficient information on wh.h to base a complete evaluation. The pu^se of this section is to 

supplement the review of the process and performance obiectives v.'i,h a more critical examination of 

three key areas. Combined, these results should provWe a thorough evaluation of the Des Moines 

Plan. The following areas were examined within each of the programs included in the Des Moines Plan: 

1 . The validity and reliability of the Wentificalion procedures: 

2. The nature of the students served in the proc^ams: and 

3. Follow up of the recommendations from previous evaluations. 

KINDERGARTEN ENRICHMENT 
Identification Procedures 
lnlrPdi>ctinn and Pfi(^w;g.^Ai|pj 
KMergaden Enrichmenl is a supplen-enlal program lo roinforoa'and extend Ih. ;o..»Ja,ior, 
oonoepis and s«,s o. <he basic kindergad.n program. I, is based on a doveiopmenta, phiiosopf, ,ha, 
recognizes individual di„eronces ,n .he g,o»,b and devoiopmen, o, young c«ren and is designed ,o 
prov* students Who demonstrate moderate developmentat deticioncies additionai experiences and 
.ime to foste, ,he devetopmental process. Students who demonstrate more severe deficiencies benefit 
from interaction with peers of a variety of devetopmentat tevets in the regutar Kindergarten program a.nd 
are provided with an additional yea, of reinforcement and growth in the K-l Transition Program. 

Wentifying appropdate candidates for the program requires procedures and instruments sensitive 
enough to distinguish students who are -moderatety behind the growth and development of their 
Chronologic peers and those who woutd benefit from an additional year of Kindergarten. Initially, 
procedures called for administering ,he Kindergaden Onrichmon, screening dovico. desioned to 
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measure specific program objectives, to students who performed below the minimum level 'considered 
prerequisite for success in kindergarten during the fall general testing, and who teachers referred for 
conskferatfon. 

Program evaluations raised a number of concerns about the accuracy of the identification 
procedures. In the first year of implementation, only about one half of the students served in the 
program were considered adequately prepared for first grade by the end of the school year. While this 
may suggest the program had little real effect on student achievement, it may also suggest that the 
klentification procedures failed to adequately screen appropriate candidates. This interpretation is 
supported by a closer review of the identification procedures. 

All kindergarten students are assessed three weeks into the school year to determine their 
standing in the kindergarten curriculum. The primary purpose of this screening is to provide teachers 
With a suggested point to Initiate instruction. Because the intent was not to -place' students in special 
programs, measures were not taken to empirically validate the screening device or to standardize the 
administration and scoring procedures. In particular, procedures did not Include specific criteria to 
Identify appropriate candidates for the Kindergarten Enrichment Program. Teachers ultimately relied on 
professional judgment to refer students for placement consideratton. The Kindergarten Enrichment 
screening device was Intended to provide finer discrimination among the developmental levels of 
3{{;de.n!s referred for placement consideration. However, this device was also not constructed 
according to recognized test development practices and failed to specify clear criteria to determine 
placement. As a result, sludents who were referred and subsequently placed in the Kindergarten 
Enrichment Program included more students who were functioning below the level targeted for the 
program. The nature of this misidentification would affect the impact of the program. 

Results of the second year's evaluation indicated that 75 percent of the students served in the 
program were considered adequately prepared for first grade. Administrators and teachers involved in 
the program felt that greater awareness among regular classroom teachers about the target population 
contributed to this improvement. Although greater awareness improved the reliability of the 



represe„,a,.„ o„.a .„,e 0, .eve,op™„,aMeve,s ,„ .e e„.e .„.e,a„e„ pop.a,.„. cu.en, 
P'ocedu,es we,e neilhe, Wended nor oreated .0 provide Ws WorrrMion 

.n.9S7.,.3S.as,ud,wasoo«<.,ed,oeva,ua,e,.eva„di,oMhe.ree„,„„„s,™.en,s.T.e 

-U,epoM.s.ud,e«n-,.ed,nere,a„ons.p,e,„een,ne,e„era,eurr,c„,„n,.ree„,„,de*e^^^ 

..e,„s,..en,.ed,oev.ua,eread,-ness,or„rs„rade.T.ev«,o„.ssoreen,n,dev,ee,s 

»"PPO«ed,o.ee.en,.M„,sre,a,ed.oa.andard.ed,.r.ro,eronoedn,ea.rea,read..u„d,o 

p.d.acade..read,ness.T.eseoond.epM.seva«one,an„ned,.ere,a„o„«p^.een 

our.en,p,aee.en,p,ocedr,res,or..eK,„der,ar,enE„.eh.en,Pro,ra.and.ee«en„ow.o. 

2--3»-M.pro,ra.„ereoon.«eredade,..e.prepared,or.3.,radea.,nee.o,,. 

™.er,ar,en,ear.C.ren,prooed„re.are.^„ed,o.eeMen,.a„ned,-s,r...no„,-rs„rade 
P.ac»on,reco..enda,.nsan«n,.„den,s«en,i„ed.™,nor,,„a,prooedures.^ 
«..,*«,„n 0, reco.mo„da„-ons ,or s,„de„,s ide„,»led w„n a standardized nor..re,erenoed 

-oson,.Me.Po,.„«ead,ne.Te..T^..e,swore.,e^^^^ 

2-eone.«onHed,s,r,.„onoUc.e.™.^ 
-~ouo.even,en,soores,0n..^^^ 

22---yoar.wore,no.ded,n.e.an,p„n,poo,.^ 

ew..rando..ass,oned,oe« 
Ihoso bu.ld.nas served as subjects for this study. 

Insirumeois 

nes„„so,..e Ba.>,«d„ood.ssessn,on, Cr»cr,o„ Re.ereneod Screening Oev.e (i.e.. Waup„n 
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«.eMe>ropo«,an«a*essTes,.^Waupu„ screen., .ev.e.use..o,oca,es,u.e„.„,..„e 
Wau^na..^....easu,esaeve.p.e„„„,o..as..o.a,„s.aua,o..v,sua,.™o,o.a.„e.a, 
P«e«eMWe„«Sc.,a...,.3.,Hac.c..a,„>..aes.e.av..a,c.,e.a,.a.™ea.,ea«^a. 

..ve,eve,s.Uve^,.eas.ess,«,se„»,.o,o,ac,,va.,o„a„ap.^.■e„e..UveM,„*as..^ 
~s a™, e,^,e ,3c.„.„a,.„. Uve, ,„ measures ,.e exten, ,o w... 

..e^re,a««.esc*eWsuaU«au*.s„».u.nv,ocuseso„,.e-..e,a.,o„p,.^^ 
Va.<.,e.es.ea.,,,.„„„,.ep.v.„s,,,n.,a.e-ap™oesses,o.en,o..ea„.se<,„e„ces,« 

.ee,e..,™.eac.oM.eau.o.,v,.aUn.ve*a,.o.a,.:a..e«e.s.o..e™.o,ao..„ 
ac.«c»„.,e,esa,>eas.oneo«eHa,„eacMo..„a,Leve,„U.easse.n,e„„s.™.a,e.a„. 
.s,.«^.eo.sa,UveM„.„a,,c.e„-a.eao.<,o.a,na,es.coess,u„™s,ereaa„.s,e.e,.e 



.t.oo«e,.,oaeve,„.T.ea.ess.e„.„.e.a,oaevena.aa*s,e..,o.«en,sw.o,a,Mo 
demonstrate proficiency on the criteria for Level II. 

~«-'-'"----<'-p.ace.e„,aeo,.o„s<,epe„.sp,,.a.yo„.eex,e„..^ 

.^..su.sp.e...,.epe.o™anceonan,.epe.en..easu.e.T.e,es„nan.„o„.eWaupu„ 

sc.e„.n,aoes„o,.epo.a„.e.<.„oe,o.^,a„„a,e«.„sea.as„e.„,„,.ev.e,o.p,ace.e„, 

2------™«-'a„asse..e„.™a..e.e„.a„oe.,o.ee.e„nM 

;'----'--s„'-ny»asu..es,„ea,op,e*u.e,«.oo.o,sucoess,n.e.e,.. 
."nderoa.e„ p,oora™ shouM sa„^,e ,.e co„,e„, o, ,M currtcu,™. ^e Waupun sceenln, 

^. *si,„. .0 ,ooa,e s,u.e„,s w,.. .0 Wa.pu„ ou,*u,™. To ,.e ex,e„, ..a, .„e .„<,e,a.e„ 

. ,. .0^^ e^,o,s Waupun, ..e co.en, va«, 0, ,.e screening ae.ce ,s s..s,anna,ea. Hcwever a 

■.^rev,ewo..e.,„.e.a.e„co.c„,„o,ec,:vos,„*a,os,.a,,,oes^,o„.Waupun,o:„c«e; 
W rtrodudion ic academic conlenl areas found in olher grade levers. 
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■ ^~'^'-''0'-np.ove,heva,,di,oMhe,«,,s,oensure«,sac.«s,ereaan<,,„,e„,^^^^ 
~,..Cons,s.e„cy ,s ™«.ec. by taw,„, expe„-.e„,a„ suppose. «e« on ,.e ,es, 
P~v«,n, e*, 3,«.fa„o„ an. aoo.n, <ns,™c,io.,.p,ov«,„, .s, no^s base. on groups. 
'««.a,swM.p.sen,,.e,a.»a,popu,a„on,orwn,on,ne,es,„a..es«ne..an^ 

.-a,ne.«an,,ne.,„a.n,,n.,eMMe..T.eexan,-ne.sn,anua,oM.eWaup„nso.e 
expw a.n„n,s.a„on ,n,n.*ns: .oweve. .„en, aCn^-n.Mion p,ac„cas .eav„y on pa™« 
v=.r„ae.w^ -eee.e ^p,ox,.a,e,y one nour o„rain,ng . on,yone„„^onen,o„.e,es,^ A 
n.n»™n, o„ou, volunteers ,s re,„.e. a, each s,,e ,o a.n„n,s,er ,.e,en«re screen., .ev.e ' ' 

~n*e.c,exan,.e,san.,.e„..prepara,.n.ee,eases..,.e,.oo.,M,beWaoponscreenin,,s 
administered consistently. 

Oesp,e,-ns„^,ons.,be^n„a„a,s,o.escr».e.en,anner,nw.e.,es„ten.„e,e.eve.pe.o, 
se<,.ence*„or.oes,provwenorn.,.e,a,a,o serve asare,a»ves,an.ar.o,oon,a„son,or 
.•n-e,p,e,a,.n. absence o, ,-n,om,a,.n ,e,ar.,„, .e en,p„.a, .eve,opn,en, o, ,ne ,es, an. 

.ac>™.nfe.a.onan.scon-^p„,e..res«s,.e,eve,o,con,«e.ea.n,Ws,ra,orsca^ 
-.-tec^™rMeasJpnsJba,a«,base..on.,he.,esu«s.o^^^ . 

T.e Enrlohn,en, screening device ,s designe. ,o nreasure ,he speci„c obfeCves o, ,he „ve 
*™,„s e.p.as.e. ,n ,ne K,n.e,,ar,en enr>c..en, P,o,ra., nan,e,y: au.,o., Wsua,, ve,.a,, n,o,or 
(».J.an.„ne,,a.soc*e„ne,,Be.av,ora,obiec.es„ereoon,b,-ne.„„.^ 
o. Wa^„„,n ,00, o, .be ,.e .on.,ns. „en,. in ,be soc,a.se„ .e,p .on,a,n were ,enera,e. by 

K-n.e„a.enEnr,c.n,en„ns,n„,o,san.cons„»an,san.re„ec,be.av,orspe,ce,-ve.essen„a„or 

success. „,s.,ra.e,S«e.,s,ece,veonepo,n,,or.™s,e„-n,eac.obiec,.e,ora,o,a,o,3ap„,n,s 

A=»,eHn,.bn.n,Sc.-eenln,Oev.e„as.eve.pe.an.,n,ro.Uce.,-M9aS,,bereare«,„e.a,a ' 
available on which lo base a (borough eyalualion cl il» technical properties 

T,eBonsas,an.ar<„.e., individually a.n,.is,ere.assessn,lZ^^^ 

^.nc«d,e„,ron,bi.hlooigh,y.a..o,age,.ewl„,,S,oc..Wne.,Gui.ubaldi,.Svinic.i.^^ 
«designed,or„seby.pecialed„oa,orsa^inlan,,preschool,an.phn,aryleache,s.™e 
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compfete BDI battery consists of 341 test Items. Ninety six Items were compiled into a comprehensive 
screening test that provides an efficient method for determining which areas of development, ff any. 
require further evaluation. The BDI screening test is recommended ror use as a general screening ' 
device for preshcool and kindergarien children, to monitor both short temi and tong tern, progress, and 
as a preliminary assessment of students considered "at risk- in any developmental area. 

The BDI measures development in five domains (Newborg et al.. 1984). Items In the 
■personal/social domain measure abilities and characteristfcs that allow children to engage In meaningful 
social interacttons. Items in the adaptive domain measure the abnity to make use of infom^ation and skills 
assessed In other cJomalns. Items in the motor domain assess the ability to use and control large and 
small body muscles. Items In the communications domain assess the receptton and expression of - 
information, thoughts, and Ideas through verbal and nonverbal communication modes. Items in the 
cognitive domain measure skills and abilities considered conceptual In nature such as perceptual 
discrimination, reasoning and academic skills, memory, and conceptual development. All of these 
domains Include subdomalns to ensure that the various aspects of each domain are adequately 



assessed. 



■«ems in the domains were sequenced by assigning each item to an'age level at which approximately 
75 percent of the children in the pilot sample received full credit. Hems on the screening test were 
selected on the basis of high Item-domain score correlations and their degree of difficulty to provide 
optimum disprimination. 

standardized procedures for test administration are provided for each of the structured items. 
These procedures must be followed to use the norm tables. Normative data were obtained from a 
stratified random sample of 80D children based on geographical regions and subreglons. race, and sex 
for each age group represented on the Invenlory. Demonraphic descnptions of the sample Indioaie ihe 
distribution of ethnic minorities and sex approximated the general population of the United Stales. Raw 
scores can be compared to cut off scores at five probablllly levels for each ago group (1 .0. 1 .28. 1 .50. 
-. 1.65. and 2.33 standard deviations below the me.^n). or may be converted to ago equivalent scores 
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w..chMca,e,.ea,ea,w.c.a,a„s<».,ep,ese„,saveraoepe.o™.e. Because aaee,*.^^^ 
-es a,e su^ec. .« ,re^e« ..«en.e,a,.„, .e au,^rs reco..en. .e™ 
caution. 



>«.Ne.heexan,.e.sn,anua,*es™,prov«e,de«e.acc«un,o,,he,e«ab»„,r«fceso, 

~BD^,*es,„<,ic.e,M,he..We..a™..,<,o^™,o,™as„,ea™„«BO,,e„.„.^ 

.««es..ep,e..o„on.e,.,.™™.,«,,3ones.e,e.a.,„.^^^^^^^ 

the screening test range from .95 to .99. 

.n.o™a„o„ae...,„,.„3 va,«^ o, ,.e con^i.e BD.^as «, available . ,be BO, scree*, .es. 
Tbe va«H, c, .e BD, sceenin, ,es, was eslabllsbea b,oo.ela„„, scores on .e scree.,^ 
.es..o,a sarnple o, ,64 children ,c scores on a subsequem adminlslraUon o„he con^lele BD, Tbe 
~„s between ,ne screening ,es, and con^arable co^nenls o, ,ne BD, ranged ,ron, ,z ,o 
^. «.« one 0, ,bese corre,a,ions were a, or above .96 «n suggesls pe„or.anca on ,.e 
screening ,es, is a sound predictor o, perton„ance on ,he complele BD,. 

^ Me„opol,an Readiness Tes, is ad^inlslered ,o a„ .Indergaden s,uden,s a, ,.e end o, .he 

^.*-gar,en,earasan^exo,prepara,.n,or„rs,,rade.«,sas,andardi.ed,sKills.basedasses^^ 
,.o,.he,oun*,ions«scons,-deredimpor,an,,orbeginning reading an^^ 

■Mc3auvran.,.66,.Tbe,es,san,p,es,ro.,ourdom.ns,ba,naveconsis,en„e.ergedinresearcnas 
essentia, ^pre-reading andp,e.n,a,ne™,ics. Tne areas include. audHory, visual, language, and 
<,ua™,a,ive sKnis. Eacn sKill area inCdes Mo sublesis ,o asses specie con^nen,s o, eac. area 
Sub,es,s in ine a,di,o. sM, area inc.de Beginning Consonanis ,o measure .e abi„y ,o .scrin,.a,e 

among inllia, sounds inwords,and,neSoundLe„erCorrespondencesub,es„on,easure,beabl,i„o 

*n,»,le„ers,na,correspond,o speccsoundsin words. Sub,es,sin,nev,sua,s.illsareainclude,ne 

VBualMa!china.sublesl,omeas"r='h"-.bi'»"'--'i-,.,,-^- ■ 

™..r.,... „b,.„, ,„ „,»or„n,„a,e among visual symbols, and the Finding 

Paltem subles, ,0 meagre ,ne abi,i, ,o ,oca,e ,om«,ions o, le„ers. groups, words, numerals, or a„i«a, 
.oner, ^.bedded in larger gr^pings. Tne language skill area includes ,ne SCoo, Language Sub,.s, 
.0 measure basic «gni,ive concepis, as well as .m,.e and n«re com^ox grammalica, s,.c«.res and 
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the Listening subtest to measure the ability to integrate and reorganize information, to draw'inferences. 
and to analyze and evaluate material that is presented orally. Finally, the quantitative skill area consists 
Of the Quantitative Concepts subtest to measure basic mathematics concepts, and the Quantitative 
Operations subtest to measure counting and simple mathematical operations. 

A number of norm-referenced scores are available to Inte^iret the results of the Metropolitan 
Readiness Test. Norm-referenced scores provide a framework for interpreting performance in relation 
to an age or grade appropriate reference group. Percentile ranks Indicate the percentage of students in 
the reference group who received scores equal to. or lowerthan. a given student's score. Stanioe- 
scores are nomialized standard scores that range from 1-9. 

Test.developers followed recognized procedures for generating the test. After an extensive review 
of research, test objectives and specifications were developed. Items for the current edition were 
drawn from a pool of items from previous editions and supplemented with new items generated and 
reviewed by content area and measurement experts. The test was field tested on a stratified random 
sample of approximately 2000 students. Once finalized, the test was normed on approximately 4500 
students from a random sample of schools stratified on the basis of district size, geographic region, 
ethrjic group, and sex. 

The manual also provides infomiation about the reliability of the Metropolitan Readiness Test. 
Internal consistency refers to the extent to which items relate to each other. The reliability coefficients 
between subtest scores ranged from .54-.90. The Pre-Reading Composite score had an internal 
consistency index of .93. Test retest reliability provides evidence of the stability of test scores over a 
Short period of tinie. The reliability coefficients among the subtests over a two week period ranged from 
.60-.88. The test-retest reliability coefficient for the Pre-Reading Composite score was .88. 

The test authors suggest.the extensive review of-liferaSure on which the ilom generaiior. process 
was based increases the likelihood that the items assess skills important to learning. The test's 
predictive validity was examined by comparing results of the Metropolitan Readiness Test, administered 
In the fall of 1985. tc results of the Primary 1 Level of the Metropolitan Achievement Test and the 
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Stanford Achievement Test, administered the following spring. Correlations between the Pre-Reading 
Composite score of the Metropolitan Readiness Test and the total battery of the Metropolitan 
Achievement and the Standford Achievement Tests were .65 and .83. respectively. 
Procediirgs , 

TO test the predicti./e validity of the screening devices, ihe BDI screening test was administered in 
place Of the Waupun screening in the exparimental schools at the beginning of the academic year, 
control schools conducted kindergarten screening according to traditional practices. Results from both 
groups were compared to the results of the Metropolitan Readiness Test administered the following 
spring. 

Examination of ihe validity of the Kindergarten Enrichment placement procedures required 
equating the three screening devices ar>d defining basal and ceiling cut off scores to be used as criteria 
for placement. The Waupun and BDI screening devices were equated by comparing the 
developmental level of the test rtems. Careful consideration of the age equ.alent appropriate for the 
Kindergarten Enrichment Program, and the level of functioning sampled on the Enrichment screening 
device, suggested that the ideal target population included those students who were functioning at an 
age equivalent of four to five years. 

• Once the equivalence was established critical levels (i.e.. basal and ceiling criteria) were determined 
.'or both the Enrichment an. the BDI screening devices. Results of previous administrations were 
examined to determine criteria for the Enrichment Screening Device. The average Enrichment 
screening score for the first two years of administration was approximately 16. The average screening 
score for students who were not recommended for first grade at the end of the Kindergarten 
Enrichment experience was approximately 14. Because current placement procedures tended to 
identify more students with more severe deficiencies than were appropriate for the program, a score of 
15 was defined as the critical point from which to establish basal and ceiling criteria. 

An examination of the distribution of scores from previous administrations, and consideration of 
available resources, suggested a band one ha-' standard deviation above and below the critical point 
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would Identify those students most appropriate for the program. In terms of raw scores, students who 
scored between 14 and 18 were served before all other students referred for placement. Once these 
students were ideniified. students who scored between 13 and 19 (I.e.. one standard deviation above 
arKl below the critical point) were served on the basis of need and available space. 

Comparable ranges were Identified on the BDI screening device. The range of possible raw scores 
associated with the age equivalent on the BDI screening was Identified to equate the two devices. The 
critcal point of the Enrichment screening fell approximately halfway between the range of possible 
scores.. As the range of possible scores was the same on the BDI screening. ,s midpoint was defined 
as the critical point. Similarly, scores that fell one half standard deviatton above and below this point 
were defined as most appropriate for the program (1 18-^J32). and students who scored between 1 17 
and 133 (one standard deviation above and below the critical point) were considered and served 
according to need and available space. 

Placement recommendations made by the home school teacher in cn^sultation with the 
Kindergarten Enrichment instructor at the end of the kindergarten year were also examined to evaluate 
placement procedures. Recommendations for students placed according to Waupun and Enrichment 
screening were compared to recommendations for students identified with the BDI screening. 

fiesiilis 

Predictbft Vf^|■fjjty 

The lack of specific criteria to determine a Waupun level from the screening device resulted in 
inconsistencies in the Waupun screening. To obtain a more reliable index. Waupun screening results 
were reported as the number of Items each student successfully completed. Correlations between th. 
screening devices and the Metropolitan Readiness Test scores are presented in Table S-1 . As 
expected, correlations between the Waupun screening, as reported as the number of items 
successfully completed, and the Mciropolitan Readiness Tests were stro.g.r than correlations 
^ between the Waupun level index and the Metropolitan Readiness Test. 
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Table S-1. Correlations Between Screening Tests and- 
Melropolitan Readiness test Results. 



Screening Device 


Metopolitan Readiness Test 
Reading Quantitative 


Total 




0.656 


0.578 


0.660 


Waupun Level 


0.428 


0.409 


0.437 


Waupun Items 


0.612 


0.565 


0.620 



The .awe also Indfcates correlations belweer, ,he Waupun screening (i.e., ,he number of Items 
passed on the screening) and the Metropolten Readiness Test were very similar to those between the 
BDI screertng and the MetropoNan Rea*ess Test. Squarina these correlafon coefflcients Indicates 
«.e amount of variance in the test resu«. accounted for by the sceening devtee. ample regression 
O anavses indicate the amount of vanance accounted for b, each of the screening devices was .gniffcant 
(P<.001)i however, the BDI screening device accounted for greater variance on both subtests as well as 
the total Metropolitan Readiness Test score than the Waupun screehing. 

The results of previous evaluattons raised concern about the equity of the p:.cement procedures. 
Analysis of variance procedures were used to examine the extent to which the screening devices 
distinguished between the elhnte backgmund and sex of students. The results of statistical analyses 
Wicate that while males could not be distinguished from females on either screening devT'ce. there 
were Significant differences between ntinorNy and nonminority students on both devices (F.,8.045, p 
<.001 and F..4.157, p<.05 for the BDI and Waupun screening, respectively). 

Multiple regresston analyses were then calculated ,o determine how m.ch ethnic background 
oontriwed ,o the prediction o, Metropolilan Rea*ess Test results. Table 3-2 displays the amount of 
vadance accounted for by the screening test and the ethnic bacl>ground of students. The results of 
Table S-1 and S-2 indicate while the adaton of ethnic background had lillle elfec, on the abilily ol tne 
BDI screening to predict l>«etropolilan Readiness scores. 11 did make a notable conlr«=ulion to the 
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predictability of the Waupun screening. ' 

Table 8-2. Variance of Metropolitan Readinor..;. Test Accounted for by Each Screening Test and 

the Ethnic BackQioijiid of Students. 



. fviCliopolitan Readiness 

Screening Reading Quantitative 



Total 



baigro '''''' ^ 



Waupun items and 0.417 0.420 

ethnic background 



0.442 



Placement R^oomm eodalians. Table S-3 di.p'r.ys the distribution of placemen! recommendations 
for students screened with each of the procedures. Glatio t.cal.analyses fail to demonstrate significant 
differences between these distributions; however, the results may have been contaminated by 
procedures used to examine the devices. A key prdrlem with current procedures was the omission of 
placement criteria. The process of equating the r.o.oening devices necessitated identifying such 
criteria which qualitatively altered the nature of the- oricjinal placement procedures. Specifyino this 
criteria based on the results of previous administr.;:ons increased the reliability of the placement 
procedures and improved their accuracy. 

Table S-3. Distribution of Placement Reconr.uMVJations for Students Served in Kindergarten 
Enrichment in 1987-88 hy Screening Device. 
(Peii.yiiiages) 

Recommendation Wnupun Screening bdI Screening 

Retained in kindergarten 2.96 3'45 — 

Referred to the K--; Transition Program 1 4.07 3 45 

Promoted to first-grade 82.96 93 10 
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These rr^ulls demonstrate fhe impact of .• -!.:rdi;:cd procedures on the placement process. 
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Specifying cut scores on both devices facilitated the placement procedure and increased tfie likelihood 
that students served were functioning wHhin the developmental range appropriate (or the program.. 
However, placement instruments must also be a valid measure of "developmental lever. The results 
suggest, of the devices studied, the BDI screening test provides the best predictor of Metropolitan 
Readiness Test results and is less sensHive to ethnic background. 

Student Characteristics 
The distribution of all scores on a standardized achievement measure for the general kindergarten 
population is characteristically bell shaped. Ninety six percent of the scores cluster around the average 
score. The remaining four percent of the scores fall in eHher extreme of the distribution. As the 
Kindergarten Enrichment Progr-am draws students from the major cluster, student characteristics of the 
program are likely to reflect characteristics of the district kindergarten population. The following section 
examin^'s the extent to which the sex and ethnic distribution of the Kindergarten Enrichment Program 
approximated that of the general kindergarten population. 

Males and FpfTi gl pf ; 

Table S-4 illustrates the distribution of males and females among students served in the 
Kindergarten Enrichment Progam in 1987-88. Statistical analyses indicate the distribution of ma.es and 
females in the program did not differ significantly from the distribution represented in the general 
kindergarten population. 

Table S-4. Distribution of Male and Female Students in the Kindergarten Enrichment Program and the 

District Kindergarten Population. 1987-88. 

(Percentages) 

District Kindergarten 
S3X Kindergarten Enrichment 



'^a'es ~~52.32 55.00 

Fef"alos 47.68 45.00 
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Ethnin RgprftfrffPtntiftn * 
Ethnic codes were available for 78 percent of the students served in the Kindergarten Enrichment 
Program during 1987-88. Table 8-5 illustrates the distribution of minority and nonminority students 
served In the Kindergarten Enrichment Program and among the kindergarten population In ger;eral. 
Statistical analyses indicate there was no significant difference between these distributions. 

Table S.5. Distribution of Minority and Non Minority Students Served in the Kindergarten Enrichment 
Program and in the District Kindergarten Population. 1987-88 
(Percentage) 

nfi^"'^ w ^'^^""^ Kindergarten 

Background Kindergarten Enrichment 

..^1^ Minority 18777 



Non Minority 81.23 



19.86 
80.10 



Follow Up of 1986-87 .=^ecommendatlons 

flecommpn( ^f} t i(;»p<; 

The following recommendations appeared in the 1986-87 Kindergarten Enrichment evaluation. 

In 1986-87 the Kindergarten Enrichment Program was offered as a general district curriculum. 
However, in 1987-88 the program will become part of the Des Moines Plan: A Plan for Student 
Success. This "Plan" will include most of the academic support programs offered in the district. To 
facilitate monitoring the Kindergarten Enrichment Program specifically, and the Des Moines Plan in 
general, the Kinaergarten Enrichment Program coordinator should prepare an annual budget for the 
program. 

|. ldentifir.atir>n Pro(;Briiirp<; 

The first flag in the identification procedures for the Kindergarten Enrichme.nt Program is the results 
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Of the InHial Waupun screening. The placement criteria stale that students who score at Level II or a 
-low- Level III are potential candidates for the program, but the administration and scoring procedures 
do not specify criteria to discriminate a "low" Level III. Without this specification, compliance with the 
placement criteria must be assumed. The wide range of abilities within each Waupun level increases the 
cha.xe for inconsistent interpretation of the results. To increase the reliability of the placement 
procedures the Kindergarten Enrichment Planning Committee should devise a way to document the 
results of the Waupun screening more specifically. 

Although the placement procedures were employed as specified in the program description, 
evaluating the resul.s of the Kindergarten Enrichment teacher evaluation form within the attendance 
areas for each center resulted in the inability to sen^e all students who quaWied for placement on the 
principal measure. To ensure that all appropriate students have the opportunrty to participate in the 
program, evaluation scores should be rank ordered across the district. Such a procedure also 
approximates the placement procedures of other programs in the Des Moines Plan. 

Follow Hp 

Budgftt apff f;y ;pftndit||rft ;^ 

Besponsibily for , he KIndergartren Enn'ohmen, Program was o«Wa», assu.„ed by .he Des Moir,es Plan 
. ■Coordinator in January of 1988. A separate, itentteed badge, fe prepared for each program under »,e 
plan. 

Identifiratipn prof^ffH^.r^fl 

After a review of previous results, the program coordinator. In consultation with the Elementary 
Consultant, recommended that successfully mastering 25 percent of the items on the Waupun 
screening, excluding the items in the fine motor skills domain, consituted a "low" Level III. Although this 
criterion could not be applied in 1987-88. It was piloted during implementation of the placement 
procedures In 1988-89. 

0 implementation of the study to validate the screening instruments ensured that all students across 
the district identified within the range considered most suitable for the program were given initial 
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oppcunl, ,orse.ice. l.e procedures resu.led in greater unifor.i,y in ,he ra^e oUbilHi^s ''"'^ 
represented in the centers across the district. 

K-l TRANSITON PROGRAM 
Identification Procedures 

JntrodijRtfffn 

A review o, ,he process and perfo^a^e o,-ee,.es .nd.a,es ,ha, students were «en«„ed and 
served rn ,.e prog.. a spe*d date, however, ,ho obieotlves ,al, .0 provide an oppodun* ,0 
«a.^ .he ,den„„oa,ton procedures In greater de,a.,. ^e pu^se 0, thts sectton ,s ,0 exptore the 
implenienlation and validity ot the ptacement procedures. 

Implempnlaiipj, 

Accordi,^ ,0 the progran, deson-ption, students who completed less than 80 percent 0, the entry 

^ve,o*ct.eso,.he.indergaden.rr.ulun™hy.anua.o„^ kindergarten yearcinthiscaseuanua. 

were to be evaluated with the Kindergaden Checkpoint in .anua^ and again in May. Students 
Who .a,ed ,0 earn a .inimu. 0, ,7 points on both ad«s>ra,.ns 0, the Che*poin, were reterred tor 
placemen! Into the program lor the next academic year. 

Table S.6 represents the distribution 0, the placement decisions based on the KIndergaden 

Cheo.»in, results. Students torwhomonlyone tost re« was avanablewereclassitiedaecordingto 
.ha. Single score. Students who had no test results tor eitheradministration were considered ■«« 
eligible-. 
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Table S.6. The Distribution oi PiacemenI Decisions Based 

on Kindergarten Checkpoint Results 
Placement », . 

Category dumber o Percent of 



Eligible/Served 
Eligible/Not Served 
Not Eligible/Served 
Not Eligible/Not Served 
Total Referrals 



Students students 



102 
77 
13 
15 



27.79 
20.98 
3.54 
47.69 
100.00 



were ac«„a,e, placed acco,*, ,o ..a c^eHa. Cse, examination o, ,na ^.en,s w,„ „e,e 
^ ^ns«e,ed eiigibie bu, no. sen,ed Wicaies ,na. 5, o, ihese s.uden,s n had on^ one ,es. 

aeade.. ,ea,, ,he piace.en, decisions sugoes, p^gran, personnel .ended ,o ,o,.w a policy o, 
aoceplin, s,uden,s ,or „.o. there was soiiicien, evidence ior an accuraie placemen,. Given ,he 
variable ra.e o, developmen. children oMhis age. and ,ne consequence associaled wilh 
• retaining students a year, piacemen, decis.ns based on t« test scores increased the livelihood o, 
accurately identiiyin, app,op.a,e students ,or the program. To the extent that students with on, one 
.est score were considered ineligible. 3.37 percent o, the stude* referred were placed according to 
systematic apptlcalion of specilic procedures and criteria. 

Student Characteristics 

. The students targeted ,or placement into the- K-t Transition Program represent those who are ,»<e,y 
.0 -a« in the tower extreme o, the achievement distnbution. The severety restricted nature o, this target 
,^ group increases the iWhood o, iinding ditterences between student characte,«ics o, the program 
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populaiion were used as the criteria against which to 



Males anrf Fftrpn'ftfl 
Table 8-7 represents the distribution of males and females i 



in the 1986-87 kindergarten cohort and 



analyses failed to Identify 



students served in the K-l Transition Program in 1987-88. Statistical 
significant differences between these distributions. 

Table S-7. Distribution of Male and Female Students in the K-l Transition Program 
and the 1986-87 Kindergarten Cohort. 
(Percentage) 



Sex 



Males 
Females 



K-1 

Transition 

59.13 
40.87 



1986-87 Kindergarten 
Cohort 

51.91 
48.09 



Ethnin Rftpf efifintqf ff^n 

88^Ta.eS.a.presen,s,.ee,hn..s,*u„onsa™„,s,u.en,sse.e.,M.eK.,T.ns,,.„P,o,.^ 

and.e,aae.S7.„,e,a.enco.„.«a„s„ca,ana,.es..ca,e,.a,s,„r„an„™..„o., 
=.uden,s ^ ^^^^^ ^^^^^^ 

population. 

Table S-8. Distribution of Minority and Non Minority Students Sensed in The 
K-1 Transition Program and in the 1986-87 Kindergarten Cohort 
(Percentages) 



Ethnic 



Minority 
Non Minority 



K-1 



38.89 
61.11 



1986-87 Age 
17.25 
82.75 
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tnterpfPt^fffin , 
•a.«e«nes .rom me Iowa S,a,e Oepart^n, o, Education sugoes, ,^ pe,cen,ag, o. 
s.K,e„,s ,epresen,ed in a^ specia, progran, snouM deviate man ,0 percemage points „o. 

.he *s.*, n,i„on„pe,oen,age ,0 ensure equ,ab,e de,ive„ 0, settee. While .here were no «e,e:«es 
•n «,e *,rt^,ions .or ma.es and ,e..es between ,ne K-, P™gram a^ ,ne distrW kindergarten 
^pulation. ,ne propomon o, minority students se.ed in me K-i P^gram exceeded both statist., 
expectations and state, guidelines. 

Follow Up of 1986-87 Recommendatfons 
The tollowhg recommendations were included in me ,986-87 program evaluation. 

The K-, Transition Program coordinator shouk. adius, the ..dget to retiect the average salaries o. 
-a« teachers actually involved in the program. 
Program Qhf^r^^^,i.^y,^^ 

The program coordinator should ensure that class enrollmenis do not exceed ,5 students. 

. The programooordinatorshould examine the in^lfcations o, d.prop„*nale number o, males and 
"^.nont, students se„ed in the K-, Trar.itio„ Program „ no reasonable explanation can ue to.arded 
.0 account ,or such distrtations, measures should be instituted ,o correct the discepanoy. 
IdePtifiCTtion^Placement PmroH, .r^^ 

^the program proposal has been accepted , or me 1987-88 academic year, adminfetrators are 
committed to emptying me piacement procedures as outlined. progra.m coordinator should 
ensure that those procedures are aoninistered as specitied. including documenting.Va.roun levels o, 
=11 -e-errals and accepling those students who satis, the placement cr«.,ia de.te. tor me sc,e.n,ng 
device. 

The program coordinator should explore the following alternatives to 



improvy the placement 
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procedures fori 988-89: r 

1. Examine ,he pl^se o. me K-l T,ans«™ Program ,o determine whelhe, ,he enpnasis should 
redect kindergarten or firsi grade aininilum objecllves. 

2. examMe ,ne Kindergarten Cneckpoin, and,orposs«>le aliemaiive placemen, measures agains, 
Ihe curricufum objectives kJentified above. 

Identify appropriate outcome measures on Ihe basis of the resolution of Item 1. 
4. wort. With ,he Department of Hva.uation. Research, and Testing to ensure that the placemen, 
device consistently and accurately identifies appropriate candidates forfhe program. 

Follow lip 

Budget and pypffr^^ni^rps 

OuHng ,he pilot year. ,he K-, Transition Pmgram was tunded through the Education trrprovement 
Program tund (ie.. The Pla. to, Exoellenne,. Fur«ir^ requirements incWed submitting an estimated 

budgettor.het6,a,costoI,heprogram.Es,i™tedsata^costswerebasedonthedistn-ctaverage 

teacher sata,r,or,98fr87. The average teacher sata^iorteachersintheprogram„.sconsiderab,y 
h^her than the average district saia^ and two more centers were added to accomr,„date the nun*er o. 
students identitied during screening procedures. These tactors a.=oun,ed tor the discrepancy 
betvifeen budgeted and expended figures. 

in .987-88 responswiityiorthe program was asumedbythe Des Mo'ines P.n. Aseparate budge, 
rs prepared for each program under , he plan based on expendHures for previous years. 
Program f; p,afar:tPrif ;|.^«^ 

A district committee examining the Impact o, ctass size on educational achievement determined a 
Class Size of approximately ,8 students appeared optimum for student achievement. The onginal 
P^posal to Pilot the K-, Program speCied ,8 as the target enroilment. The average Cass size for the 
1986.87 academic year was 18.5 students. Sixtytwo percent ot ,he centers had ctass sizes that 
exceeded the target tevel. The results o, the pilot and a review of recent research in this area 

suggestedthataclass Size o,a„east,2-,5studentswould be necessan„o adequately pro«e,orthe 
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needs otlhesestudems. Class sizes forlhel 987^8 aoademio year rellecl .he new cr«erta'. 

KiUi-ansrtiQn f^tiirfftpf r7f^f,rnf:tcri,itici 

The resu«s o, me ,986^7 evaluaUor .,™„„a,a,ed sig„,„can, dMerences amo,« ,he se« and 
ethnic disintuiions ol ,he student se.ed in ,he ^og«m and the age appropHate d^tn'ot ooho. 
Signir^nti, „x„e n,a,es and n.-nomy students were se«ed than would be expected trom the generat 
Wnoergarlen population. 

While research supports the discrepancy tor eth„b«y. mtie evide,»e is avaibble to supped ,he 
Obsenred ditterences beN^een the distrMons ot males and temales. Fa»ing to tind such support 
Challenges the va«y o. the «en,i„cation procedures. The abse^e o, such a dWerence in the results 
o. the 1987-88 evaluation suggests that e«orts- were made to strer^hen the identiticafon procedures 
10 identity those students most in need of the sen,ice regardless ot race or sex. 
Identificalinn pi angmpnl Pf „^^„^. 

Theo-con^s noted above are the probable results of an extensive review of the aentification and 
Placement procedures guided by the program coordinators during ,987-88. Coordinators asse,rt,ied a 
team o, Kindergaren, K-, Transition, a^t first grade teache. to examine the purpose, goats, a,K, 
Objectives 0, the K-, TransiUon Program re,a,.e to M^ergarten and rrs, grade currtculum expecat.ns 
.B..S group then cond^ted a cr»ca, examination ol the ,ems on the Kirxtergarten Checkpoint ,o 
en^rre they acourateiy reflected these go.,s. Each «em was c«ed w«h addHiona, administration arx, 
scoring instntcf-ons to standardize the administration procedures, identitication cnleria were 

determinedonthe basis Of previous results. Many Of these changeswerepiiotedin the spring o„987- 
88 and „ii, be incorporated into the program in t988-89. The program coordinators and others invoived 
in this review should be commended for their efforts. 
. The K-1 Transr-tion Program should also beneffl from the examination of the sceoning devic. for ^ 
lOndergartren Enrtchment Program tdeally, the instn^mont selected should provide adequate 
*crimi„ation among student abilities a, the beginning and end o, the kindergarten year. An instrument 
common to the Kindergarten Enrichment and K-, Trans,ion Programs would improve the roliabi„y and 
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validity of placement procedures for all early elementary school programs. 

DES-MOINES- PL"AN"READiNG7WRTflN& AND MATHEMATICS LAB PROGRAMS 

Identification Procedures 

IntrodtjRtlQn 

The Des Moines Plan became officially implemented at the time of administration of checkpoints in 
January of 1988. These tests which are given in the areas of reading/Ianguage arts and mathematics at 
grades 1. 3. 5. and 8 and in writing at grade 11 are objectives based tests that are designed to measure 
attainment of objectives that are appropriate for students at those particular levels. As such, the tests 
are used as a prirriary tool for selecting students that will be served in The Des Moines Plan. Scores 
obtained by students on checkpoints mr.y fall in any one of thrf e categories: -pa.vs." "range of 
reconsideration." or "not pass." Students who do.not pass checkpoints are selected for Des Moines 
Plan instruction; Those who fair in the "range of reconsideration" may be served particularly if certain 
other Criteria are met. The bands for the various categories are established in order to detemiine a 
certain percentage of students at each grade level at which the checkpoints are administered that will be 
served in The Des Moines Plan. For example, the tests are to identify the lowest 20 percent of students 
in reading for grade 1. 

In addition to be used as an instrument to select students, the checkpoint tests are also used to 
help determine when a student may be exited from the program. After selection for The Des Moines 
Plan, students ^re given three more chances to pass the same checkpc>int(s) before being retained at a 
particular grade level. Durir.g this entire period which may span a period of one and one half calendar 
years, students are continuously being provided supplementary instruction through the reading/writing 
and or mathematics lab classes. 

An important factor that surfaces in relation to any testing program, perhaps particularly in one in 
whict^ results are used to select students for special sewices. is that all studgnts who are eligible to 
complete the assessment Instrument do so. The percentage of students at each grade level for whhh 
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Checkpoints were completed In January of 1988 ranged from 97.3 to 98.3 percent for grade levels 1. 3. 
.Sand 8. 

Conclusior] «^ 

It appears that proper procedures were followed In the first major administration of checkpoints in 
January. 1988 to the extent that a high percentage of the population at each ojrade level completed the 
instrument. Students who did not pass the checkpoint In January were retested in May after receiving 
servfce In the Des Moines Plan labc. Records will be kept of the students that failed io oass the Initial 
checkpoint to determine the length of time that these students spend In The Des Moines Plan labs ' 
before being exited. 

Student Characteristics 

IntrodiictiQn 

In addition to information conceming the number of students served at each grade level and by 
building In the Des Moines Plan, further data was collected concerhinp the ethnic representation of 
students served during 1987-88. Table 8-10 presents data on pan.cipation of minority and majority 
students in The Des Moines Plan during 1987-88. Minority/non minority representation for the district is 
also presented for comparitive purposes. 



Table 8-9. Minority and Non Minority Representation 
Des Moines Plan Lao Program 
1987-88 
(Percentages) 





Rcadng 


Malhpmatics 


Tofallflh 




Minority 


29.21 


29.39 


28.45 


Pi^trKl. 
18.03 


Non 'Minority 


70.79 


70.61 


71.55 


01.97 



X 2=538.216. p<.001 
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Conclusion t 
^As shown byTabIe-S:9V28:45Wrcent of the student population in if^e Des Moines Plan Lab 
Program (all students, both programs) was made up of mirx)rity students. This compares to a district 
minority rcentage of 18.03. When the chi square statistic Is computed, it Is fourxJ that this difference 
In minority percentage is of the magnitude to be statistically significant meaning in this case thai the 
difference would Jrave occurred by chance less than 1 tir.. out of 1000. State guidelines suggest that 
the percentage of mino.ity students represented in any special program should not deviate more than 
10 percentage points from the district wide minority percentage to ensure equitable delivery of service. 

Follow Up of 1986-87 Recommendations 
IntrodiintiQq 

Several recommendations were offered in the 1986-87 evaluation reports for Chapter I Reading 
and Mathematics Programs. It would seem appropriate at this point to highlight these and to briefly 
indicate a follow-i,p,of activities or changes noted in the 1987-88 programs. To do this, several 1956- 
87 recommendations are quoted followed by the appropriate update. 

■19 86-87 Rftcommftnriat ipr] 

The program objectivo that relates to performance of first grade students on the Iowa Tests of 
Basic Skills should be revised to specify a criterion for attainment consistent with those at other grade 
levels. This would require specifying the "average gain- to be attained rather than a percentage of 
students that will reach a certain level. The average gain will best provide information on the entire 
population rather than only those who achieved a certain score." 

1987-RR Fnlbw l ip 

This objective was revised in order to specify an "average gain" and to therefore be cc nsistc ^t with 
other performance objectives. 

1986-87 Recommf>n( ij^{iffrj 
"The importance of school attendance should continue to be a thrust of the secondary program. 
The attendance rate for Chapter I students during 1986-87 w.s 91 .2 percent in math and 90.9 percent 
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.__Ji^■^ggg^g^J2''s represented Mim^^ 

percent for non mathematics program students and 92.8 percent for non-reading program students." 

1987-8fi FQl!,7v^lp 

The attendance rates for Des Moines Plan students at the middle school level were 88.9 percent In 
the ReadingAVriting Lab Program and 89.8 percent in the mathematics program. This compared to 
rates of 92.8 percent for non reading program students and 93.1 percent for non mathematics program 
students. Attendance rates for Des Moines Plan students fell slightly from levels of the previous year 
resulting in a wider deviation of their attendance from (he attendance rates of non-program students. 

1986-87 Rpnr.mmanH;^t;^~ 
"Stronger emphasis should be applied in the area of parent contacts at the middle school level in 
order to meet or exceed specified criterion levels." 

19 87-88 Fnllnw^ lp 

Criterion levels for parent contact were exceeded in both the Reading/Writing and Mathematics 
-Programs in middle schools during the 1987-88 school year. It should be noted that expectations were 
made fess stringent than in the previous year through a revision of objectives in both programs. 

1986-87 Rp pommprif iH t 'On 
-The Chapter I Par3nt Survey shou' be abolished as The Des Moines Plan becomes operational 
during the 1986-87 school year. A more comprehensive questionnaire should be designed and steps 
should be taken to obtain a rate of return that will allow stating of generalizations from a sample to the 
entire population." 

1987-88 F.ollp w l,lp 

During the 1987-88 school year, a revised parent survey was developed and administered. 
A somewhat beUer return rate was experienced, though it was still insufficient to allow for generalization 
of results to the population at large. 

1986-87 Rp. qommencim iQt ] 
"The-criterion levels for achievement gains of students should be studied as The Des Moines Plan 
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becomes iiTTplemenled. This is necessary to determine that the criterion levels for gain that &re 



specified represent a change in achievement that is not likely due to measurement error or chance. 
Statistical tests of significance are useful in determining this." 

1987-88 Follow \ }q 

Student performance has been traditionally measured in the Chapter I programs by assessment of 
the amount of "gaihs" that: students make from pre to post testing with a norm referenced instrument 
such as the Iowa Tests of Basic Skills. The 1987-88 Des Moines Plan objeciivss specified this same 
method for measuring student achievement. A significant question related to the general definition of 
vrfidity is raised concemina the appropriateness of using such an instrument, i.e. does such an 
Instfument measure whaj we want to measure as outcomes? 

Several years prior to implementation of The Des Mohes Plan.' an issue was raised regarding the 
^ possibility of using a locally developed measure in place of a nor.n referenced instrument to measure 
growth on a pre/post basis. Contact was made at that time with the appropriate officials at the slate level 
19 determine if this was permitted in a program funded by Chapter I. and if so. under what conditions. 
The rationale for entertaining this approach was the feeling that a locally developed objectives 
referenced test would provide a closer match with the curriculum objectives presented to students in 
, - • the lab programs than would any standardized test. In other words, we would be establishing an 
outcome measure that would clearly be better matched with the objectives of the curriculum being 
taught. It was discovered that the major requirement that must be satisfied in order to implement this 
procedure is the generation of local norms and the subsequent ability to convert these to standard 
scores and then to Normal Curve Equivalent (NCE) scores for state reporting purposes. 
No specific action was carried out in response to this recommendation in 1987-88. 

CONCLUSIONS 
Identification Procedures 
In general, procedures to identify students for all programs included in the Des Moines Plan were 
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-J!!""!"'' ''^^''"9 iMhe respective program descriptions. Preliminary 

results of a-ri^evalDitioTof the devfc^^ - 

Enrichment Program suggest that a standatl^i^ed individually administered assessment battery (the 
Battelle Devetopmenta! Inventory) was a better predictor of Metropolitan Readiness Test results and 
less sensnive.:o the ethnic background of students than the Waupun Curriculum Screening D.evice. 
This investigation is ongoing. 

Student Characteristics 
state guidelines suggest that the percentage of minority students represented in any special 
prog^am should not deviate more than 10 percentage points from the district wide minority percentage 
to ensure equitable delivery of service. While the distribution of minority students represented In the 
KirKlergarten Enrichment Program satisfied this criteria, the minority representation exceeded this 
standard in the K-1 Transition and Lab Programs. 

Follow Up of 1986.87 Recommendations 
Evidence was available to suggest that a majority of the recommendations specified in 1986-87 
evaluations of ihe programs later subsumed in The Des Moines Plan were addressed by program 
coordinators. The results of a roview of the procedures used in determining gain criteria on the 
•outcome measure in the lab programs Is expected. 

RECOMMENDATIONS 
Identification Procedures 

1 . The Supervisor of the Des Moines Plan should continue to work with the Coordinator of 
Testing and Research to develop procedures that accurately identify students for the early elementary 
suppori programs. 

2. The Supervisor of The Des Moines Plan .id consider including an item relating to the 
identification procedures in the process and performance objectives for all Des Moines Plan programs 
1o ensure that such procedures are evaluated on a regular basis. 
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Student Characteristics * 



1 . The Supervisor of The Des Moines Plan should corii'oue to monitor the distribution of" 
minorlty/nonminority and male/female students in the program. Particular efforts should be directed to 
ensuring that minority student representation does not exceed state criterion levels. 

Follow Up of 1986-87 Recommendations 

1 . The Supervisor of the Des Moines Plan should contln-je to examine procedures currently 
employed to detemiine the criteria for "success." particularly in the lab programs. 
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INTRODUCTION 

- Background- 

A major component of the long range plans to irnprove the quality, of education in the Des IVIoines 
Public Schools focuses specifically on strengthening programs for low achieving students. The 
Des Moines Plan: A Plan for Student Success was implemented in 1987-88 to coordinate remedial 
effort, i.- the district. The Des Moines Plan is motivated by the assumption that all students can learn. 
Recognizing students learn in a variety of ways, programs in the plan are designed to provide alternative 
methods to facilitate the acquisition of skills. Early elementary progr. , center around a developmental 
philosophy that acknowledges student development through age seven occurs at variable rales. 
Programs are designed to allow children time and reinforcement to develop an adequte foundation for a 
successful learning experience in first grade and beyond. Early elementary programs include the 
Kindergarten Enrichment and K-1 Transition Programs. Students who demonstrate moderate 
developmental deficiencies are placed In the Kindergarten Enrichment Program, a half day 
supplemental program designed to reinforce, without duplicating, the regular kindergarten curriculum. 
Students Who demonstrate significant developmental deficiencies benefit from Interaction with peers in 
various stages of development in the regular kindergarten program and may be given an additional year 
of reinforcement in the K-1 Transition Program. 

Students Who fail ,o satisfy district standards in the basic skills areas receive remedial assistance 
through Reading/Writing and Math Labs. Modelled after the District's Chapter I and II Programs, the 
basic skill labs allow students to strengthen specific weaknesses through educational experiences that 
capitalize on Iheir learning strenp.hs. Students at the elementary level are served on a pull-out basis. 
Students at fho secondary level receive assistance through regularly scheduled courses. 

Students who receive remedial assistance for three consecutive semesters, and have had the 
opportunity to participate in summer school programs, but continue to demonstrate:critical deficits are 
retained in special curriculum rooms. These "transition" rooms are inserted between grades 2 and 3. 4 
and 5. and 6 and 7. Special emphasis is given to the basic skills of math, reading, and writing. 

o 260 
ERIC ^ 



2-173 

A key component of the identification procedures for the remedial programs is the distrfct^ 
Checkpoint program. Checkpoints are criterion referenced tests designed to measure grade level 
masteo. of basic skills. Th'iy are administered in grades 1 . 3. 5. 8. and 1 1. Students who fail to satisfy 
minimum standards are considered for remedial assistance. 

The Des Moines Plan was officially initiated in the spring of 1988. While the structure of the program 
provided for immediate implementation of the early elertientaor and basic skill lab components, the 
stipulation that students must participate in the lab program for three consecutive semesters delays 
implementation of the transition rooms until the 1989-90 academic year. 

Program Evaluation 
The philosophy and structure of the Des Moines Plan suggests that early identification and 
inten/enlion should affect greater change in academic achievement and may reduce the need for 
additional remediaton. More specifically, to the extent that the Des Moines Plan is effective in meeting 
the needs of students, there should be greater turnover among the students served in remediaton 
programs, particularly among students who participated in early elementary prevention programs. There 
Should also be a reduchon in the number of students retained in transition rooms. 

The nature of this assumption suggests the true impact of the Des Moines Plan may net be evident 
for some time. This longitudinal study is designed to provide the information necessary to evaluate ine 
impact of the Des Moines Plan on student achievement. The purpose of this paper is to describe the 
design and methodology that.will be employed in the longitudinal study and to provide information to 
serve as baseline criteria against which to evaluate the effectiveness of the plan. 

METHOD 
Subjects 

All students, and their parents/guardians, who were identified and served in Des Moines Plan 
programs during the spring of 1988 will be included in the longitudinal study. 
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Measures r 

Indepenrfpnt v^n^hi^c^^ 

isolating the impaci of the Des Moines Plan programs will . quire controlling for other variables that 
effect academic achievement. Students' sex. race, socioeconomic level, parent/guardian level of 



education, preschool experience, participation in alternat 



ive support programs (e.g.. English as a 
Second Language etc.). and attendance will be collected to determine the extent to which student 
achievement is accounted for by these factors and how much is due to p. licipation in Des Moines Ran 
programs. 

DeoendPnt Vf^rif^hipc^ 

To the extent that the programs are effective, there should be a reduced ne. , .or continued 
services and a reduction in the number of students who are retained. The need for services will be 
monitored by the results of district checkpoints and the number of days spent in Des Moines Plan 
programs. Particular attention will be given to monitoring the recidivism rate among students served. 

Prior to the introduction of the Des Moines Plan, students were retained at any grade level 
according ,o the professional opinion of teachers and approval of parents. Table L-1 illustrates the 
retention rates by grade for the past 5 years at the elementary level. 



Table L-1. Retention Rates for Kindergaten Through Grade Six. 1982- 



1987 



Year 


Kndg. 


K-1 


1 


Grade Level 
2 


3 


4 


5 


6 


Total 


1982-83 


87 

* 




131 


64 


~32 


19 


n 


3 


347~ 


1983-84 


93 




180 


52 


23 


16 


9 


25 


398 


1984-85 


94 




119 


57 


21 


8 


9 


62 


370 


1985-86 


58 


144 


92 


38 


23 


13 


10 




378 


1985-87 


44 


117 


131 


67 


21 


21 


7 




364 
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introduction of the transition rooms will eliminale.retenlions by grade, those students who fail to 
satisfy district standards in the basic skills after three consequtive semesters will receive an additional 
year of remediation in transition room's. To the extent that the plan is effective, enrollment in the 
transition rooms should be fewer than the combined rates of the grades immediately preceeding and 
following the transition grade. There should also be a pronessiye decrease in,l6e enrollment figures for 



each transition level. 



Procedurt^s 

Most of the demographic information forsludenis served in the programs is avaiiable from student 
records. Information regarding students socioeconomic ievel will be obtained through applfcalions for 
the free and reduced lunch program. Parent/guardian educational experience and studenfV level of 
preschool experience will be obtained through a parent/guardian survey. 

Student derr raphic informatio.i will be supplemented with district achievement results and 
attendance records availabe through the district and a data base designed specifically for the Des 
Moines Plan. 

Results 

The results of the longitudinal study will be updated on a schedule concurrent with the checkpoint 
assessmets for the or:ginal cohort. The iniitial report, scheduled for release-in 1988-89. will provide a 
detailed description of the students under study including the first checkpoint results. Subsequent 
reports will be released following 1990-91. 1992-93. 
1995-96. and 1999-2000. 
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INTRODUCTION ' 
A review of the process and performance objectives for each program supplemented with an 
examinationfof the identification procedures, student characteristics, and follow up of previous 
evaluations, identified the extent to which each program in the Des Moines Plan was implemented as 
intended. These results provided information necessary to lay the ground work for a longi.udir..! study 
Of the effects of the Des Moines Plan on student achievement. They also identified factors that have 
implications fcrthe deliveo^ of the programs In general. The following conclusions and 
-^recommendations are based on a synthesis of these7esults. 

CONCLUSIONS 
Philosophy and Goals 

The evaluation of the process and performance objectives of the early alementao^ support programs 
indicated that both programs provided distinct experiences that consistently and eccur£tr:y reflected 
their respective goals and philosophies. However. In 1988-89 the Kindergarten Enrichment Program 
will be modified to serve students who demrnslrate the greatest need for academic support. 
Accommodating these students will require significant adjustments to both the identification procedures 
and the outcome expectations of the program. The additional preparation should have a direct ..IfecJ on 
the nature Of the K-i Transition Program, and may be felt in the elementary lab programs as well. 

Identification Procedures 

Ic^entification procedures for all programs in the Des Moines Plan were determined after careful 
consideration of district resources. Consistent w.ih the philosophy of the Des Moines Plan, greater 
emphasis was given to serving students at the elementary levels. For example, provisions for the 
Reading/Writing and Matf. Labs included serving 20 percent of the students in grades 1 and 2. 15 
percent of the students in grade 3. 1 0 percent of the studems in grades 4-6. 8 percent of the stud.n.s 
in grade 7. and 5 percent of the students in grades 8-1 1 . Once defined, checkpoint criteria were 
established to identify students according to these proportions. For example. students who scored in 
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Ihe lowest 20% of the scores on the first grade reading checkpoint were served in the Readinp/Writing 
Lab. etc. 

While procedures based on percentages ensure that those students most in need receive supporl 
services, they also introduce the possibility of serving students who do not really demonstrate need, m 
other words, current identification procedures do not consider the level of mastery demonstrated on the 
checkpoints, but are based on the distribution of the ched.point results and the number of spaces 
-available for service at each grade level. For.xample. a first grade student who scored 80 percent on a 
checkpoint could be identified for service if that .score fell among the lower.20.percent of.all first.grade. 
checkpoint scores. 

Test, development procedures provide one safeguard against misidentifications of this natu're. 
District Checkpoints are designed to measure mid year mastery of curriculum objectives and are revised 
to refect any modifications in those objectives. Increasing the difficulty of the curriculum objectives 
should increase the difficulty of th. •-^.r^ooints a^d therefore, improve their power to differentiate 
among students' level of functioning. To follow up the example, a score of 80 percent would not likely 
fall within the range of identification on a more difficult checkpoint because the range of all first grade 
checkpoint scores would be .much ^,roader. However, curriculum objectives are reviewed on a five year 
schedule and developing new tests to reflect changes may take up to two additional years. This lime 
line may not be sufficiently sensitive to avoid misidentifications. 

Organizational Structure of the Management System 
The Des f^oines Plan was based on the district's Chapter programs. In 1986-6/. the Chapter 
programs involved 31 schools across the district. In 1987-88. the Des Moines Plan included all 
elen;entary and seconddry schools offering regular academic programming in the district: some 58 
buildings. The Des Moines Plan also acquired two early elementary programs with their accompanying 
personnel, iu addition, tho Chapter programs .elied on two sources of funding; however, approximately 
82 percent of the funds for the Des Mointis Plan were contributions fron. five stale or federal sources. 
While the system utilized to manage the Chapter prqgrarns.successfully-accounled for the- 
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»p.e.en,a,,o.o,.osep,o,.-a.s,.e.a.esvs,en,,a,,e.,o»,.s,a„a.e.e.an*,^o.'e.,,,,e 
. <pan.ons associated wi,. ,.e Des Moines Plan. .ocoun,a.i„, „,es „ere es^sned ,o .cn„o„ne 

obiec,.e.o,eacnp,o„an„n,HeOesMo,nesP,an,an<,.,.neacno.a.e,eve,onne,a.p,o,.a.s„e 

e..en,a.,...e,an.„,nscnoo,,.,,S.«e,,,nena,.eonnep.o,a.o,e.,veso 

. n,a«a.:^ n,.„p,e sets on»es -n ,ne sa.e aooa.en,a„on. runne^re, .oulanons as.^^^^^^^ 

w*.Hea,,oca,,ono,.n<,s,™.ex,e.a,sou.escon,p„ca,e.,ne™,n,enanceo,accoun„e.»«s,o, 
each program. 



RECOMMENDATIONS 



The ICWng recommendalion. a,e based on .he conclusions lisled above 
1. The S„pen„so, 0, The Oes Moines Plan should .eel wllh ,ep.esen,a,lves ,he Oepa^.enl o. 
H..en,ao, Hducallon. ,he Oepa..en, o, Hdocallonal SeMces, and ,he Oepah.en, o, .va.allon 

^^Besea,ch.andTes,ln,,o.v,e.,he,.pl,ca,lo„so,,he™d„,ca,lon,o,he.nde,ahenBnhch.^ 

P-o.an,onolhe,OesMolnesPlanp.o.a.s.Pah-.la.a,lenl,ons.u,dbe,.en,oe,a.lnln„he 

.^pac.o,,hlscha„,e on ,helden,,,,ca,lonp„cedo,es a. 00,00.0 e,:>ec,a,.„so,,heK.,T.ans,lon 
and first grade lab programs. 

_ . ^. ^-'■''-"^^3ope„isoro,TheOosMolnesPlans>.ld,nee,wllhrepresen,a,lves„o.,he 

Oepa..en,o,.le™n,a.Edoca,lon.lheOepa..enlo,Seconda,.doca„on.,heOepa..en,o, 
e^a,,o„,«_ch.andTes,,n.and,heCoo.^^^^^ 

alloca.o„ oucaden^c sopped .sources. The nu.be, o, sludenls se.ed a, each „ade level ' 

3^u,d be de,e,n,lned on , he basis 0, available ..esou,ces. chec^poln, .sulls, and olhe.elevan, 
^formation. 

3. -.-he . .pen,lso, o, The Oos Molnes Plan shou« .oe, „l,h ,ep.sen,a„ves .on, ihe Oopadn,en, o, 
Hvaluallon, Research, and Teslln. and ,he Conirolle.s Ollice lo devise a syslen, lo n,onl,or ,ha 
■mplemenlallon and accounling o, ,he Des Molnos Plan more elllciemly 
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